2026-03-30 11:00:03 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 11:00:03 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 11:00:03 [auto1.es] INFO: Batch mode enabled: batch 1/2
2026-03-30 11:00:03 [auto1.es] INFO: Starting spider auto1.es
2026-03-30 11:00:03 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 11:00:03 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 11:00:03 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 11:00:03 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 11:00:03 [scrapy.extensions.telnet] INFO: Telnet Password: ff3dfe7e62fda853
2026-03-30 11:00:03 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 11:00:03 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_21_2026-03-30T11_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 11:00:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:00:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:00:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 11:00:03 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 11:00:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 11:00:03 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 11:00:03 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 11:00:04 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 11:00:04 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 11:00:04 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 11:00:04 [scrapy.core.engine] INFO: Spider opened
2026-03-30 11:00:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:00:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 11:00:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-30 11:00:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:00:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 11:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 11:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 11:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 11:00:13 [auto1.es] INFO: Channel: 24h | Page: 0 | totalHits: 2190 | hits on page: 40
2026-03-30 11:00:13 [auto1.es] INFO: Found listing with ID: YW75057
2026-03-30 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW75057%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.es] INFO: Scrape type for YW75057: 2
2026-03-30 11:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e0cfcee-9439-58a3-85e7-7044486801ac with identifier: YW75057
2026-03-30 11:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e0cfcee-9439-58a3-85e7-7044486801ac with scrape type 2
2026-03-30 11:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e0cfcee-9439-58a3-85e7-7044486801ac with scrape type 2
2026-03-30 11:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e0cfcee-9439-58a3-85e7-7044486801ac, identifier: YW75057
2026-03-30 11:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e0cfcee-9439-58a3-85e7-7044486801ac with identifier: YW75057
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 11:00:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 11:00:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e0cfcee-9439-58a3-85e7-7044486801ac with identifier: YW75057
2026-03-30 11:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e0cfcee-9439-58a3-85e7-7044486801ac with identifier: YW75057 to the API
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:05:20Z',
 'fuel_type': 'petrol',
 'id': '4e0cfcee-9439-58a3-85e7-7044486801ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW75057',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 175187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-24',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2009}
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW75057%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.es] INFO: Saving data for YW75057: {'auction_closing_time': 1774969520.0, 'created_time': 1774263681.420751, 'last_price_update_time': 1774868415.891068}
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YW75057') HTTP/1.1" 204 0
2026-03-30 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:15 [auto1.es] INFO: Found listing with ID: MP93470
2026-03-30 11:00:15 [auto1.es] INFO: Found listing with ID: NS19372
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS19372%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.es] INFO: Scrape type for NS19372: 2
2026-03-30 11:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 985041e8-4008-5dc9-ab4f-3ca3399d946c with identifier: NS19372
2026-03-30 11:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 985041e8-4008-5dc9-ab4f-3ca3399d946c with scrape type 2
2026-03-30 11:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 985041e8-4008-5dc9-ab4f-3ca3399d946c with scrape type 2
2026-03-30 11:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 985041e8-4008-5dc9-ab4f-3ca3399d946c, identifier: NS19372
2026-03-30 11:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 985041e8-4008-5dc9-ab4f-3ca3399d946c with identifier: NS19372
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 11:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 985041e8-4008-5dc9-ab4f-3ca3399d946c with identifier: NS19372
2026-03-30 11:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 985041e8-4008-5dc9-ab4f-3ca3399d946c with identifier: NS19372 to the API
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:56:14Z',
 'fuel_type': 'hybrid',
 'id': '985041e8-4008-5dc9-ab4f-3ca3399d946c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS19372',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 174639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seller_name': None,
 'title': 'BMW 2er 225xe Active Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS19372%27 HTTP/1.1" 200 None
2026-03-30 11:00:18 [auto1.es] INFO: Saving data for NS19372: {'auction_closing_time': 1774972574.0, 'created_time': 1773691493.367246, 'last_price_update_time': 1774868418.651294}
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NS19372') HTTP/1.1" 204 0
2026-03-30 11:00:18 [auto1.es] INFO: Found listing with ID: SU99027
2026-03-30 11:00:18 [auto1.es] INFO: Found listing with ID: TS87015
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS87015%27 HTTP/1.1" 200 None
2026-03-30 11:00:18 [auto1.es] INFO: Scrape type for TS87015: 2
2026-03-30 11:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42f1d19f-228a-5ba3-b773-6798e33d9ba4 with identifier: TS87015
2026-03-30 11:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f1d19f-228a-5ba3-b773-6798e33d9ba4 with scrape type 2
2026-03-30 11:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42f1d19f-228a-5ba3-b773-6798e33d9ba4 with scrape type 2
2026-03-30 11:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42f1d19f-228a-5ba3-b773-6798e33d9ba4, identifier: TS87015
2026-03-30 11:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42f1d19f-228a-5ba3-b773-6798e33d9ba4 with identifier: TS87015
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 11:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42f1d19f-228a-5ba3-b773-6798e33d9ba4 with identifier: TS87015
2026-03-30 11:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42f1d19f-228a-5ba3-b773-6798e33d9ba4 with identifier: TS87015 to the API
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:05:32Z',
 'fuel_type': 'diesel',
 'id': '42f1d19f-228a-5ba3-b773-6798e33d9ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS87015',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 79635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-04',
 'seller_name': None,
 'title': 'Volkswagen Jetta 1.9 TDI Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2007}
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS87015%27 HTTP/1.1" 200 None
2026-03-30 11:00:19 [auto1.es] INFO: Saving data for TS87015: {'auction_closing_time': 1774969532.0, 'created_time': 1773496870.613295, 'last_price_update_time': 1774868419.56496}
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS87015') HTTP/1.1" 204 0
2026-03-30 11:00:19 [auto1.es] INFO: Found listing with ID: MP75885
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP75885%27 HTTP/1.1" 200 None
2026-03-30 11:00:19 [auto1.es] INFO: Scrape type for MP75885: 1
2026-03-30 11:00:19 [auto1.es] INFO: Found listing with ID: UL16630
2026-03-30 11:00:19 [auto1.es] INFO: Found listing with ID: PG13200
2026-03-30 11:00:19 [auto1.es] INFO: Found listing with ID: DF86538
2026-03-30 11:00:19 [auto1.es] INFO: Found listing with ID: PH25180
2026-03-30 11:00:19 [auto1.es] INFO: Found listing with ID: GJ97724
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ97724%27 HTTP/1.1" 200 None
2026-03-30 11:00:19 [auto1.es] INFO: Scrape type for GJ97724: 2
2026-03-30 11:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3876421-f6c4-5f9f-8718-e908a7e8742e with identifier: GJ97724
2026-03-30 11:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3876421-f6c4-5f9f-8718-e908a7e8742e with scrape type 2
2026-03-30 11:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3876421-f6c4-5f9f-8718-e908a7e8742e with scrape type 2
2026-03-30 11:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e3876421-f6c4-5f9f-8718-e908a7e8742e, identifier: GJ97724
2026-03-30 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e3876421-f6c4-5f9f-8718-e908a7e8742e with identifier: GJ97724
2026-03-30 11:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e3876421-f6c4-5f9f-8718-e908a7e8742e with identifier: GJ97724
2026-03-30 11:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e3876421-f6c4-5f9f-8718-e908a7e8742e with identifier: GJ97724 to the API
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:01:56Z',
 'fuel_type': 'diesel',
 'id': 'e3876421-f6c4-5f9f-8718-e908a7e8742e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ97724',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 188041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-06',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2014}
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ97724%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.es] INFO: Saving data for GJ97724: {'auction_closing_time': 1774969316.0, 'created_time': 1774296322.442819, 'last_price_update_time': 1774868421.173077}
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GJ97724') HTTP/1.1" 204 0
2026-03-30 11:00:21 [auto1.es] INFO: Found listing with ID: NG43974
2026-03-30 11:00:21 [auto1.es] INFO: Found listing with ID: PR99923
2026-03-30 11:00:21 [auto1.es] INFO: Found listing with ID: PH51159
2026-03-30 11:00:21 [auto1.es] INFO: Found listing with ID: MV24721
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV24721%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.es] INFO: Scrape type for MV24721: 1
2026-03-30 11:00:21 [auto1.es] INFO: Found listing with ID: RL41759
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL41759%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.es] INFO: Scrape type for RL41759: 1
2026-03-30 11:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:21 [auto1.es] INFO: Found listing with ID: PK44765
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK44765%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.es] INFO: Scrape type for PK44765: 1
2026-03-30 11:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:21 [auto1.es] INFO: Found listing with ID: JN78830
2026-03-30 11:00:21 [auto1.es] INFO: Found listing with ID: NA33404
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA33404%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.es] INFO: Scrape type for NA33404: 2
2026-03-30 11:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19d219f-915b-5ec5-80b9-555f1d216dc3 with identifier: NA33404
2026-03-30 11:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19d219f-915b-5ec5-80b9-555f1d216dc3 with scrape type 2
2026-03-30 11:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19d219f-915b-5ec5-80b9-555f1d216dc3 with scrape type 2
2026-03-30 11:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b19d219f-915b-5ec5-80b9-555f1d216dc3, identifier: NA33404
2026-03-30 11:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b19d219f-915b-5ec5-80b9-555f1d216dc3 with identifier: NA33404
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 11:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b19d219f-915b-5ec5-80b9-555f1d216dc3 with identifier: NA33404
2026-03-30 11:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b19d219f-915b-5ec5-80b9-555f1d216dc3 with identifier: NA33404 to the API
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:10:07Z',
 'fuel_type': 'diesel',
 'id': 'b19d219f-915b-5ec5-80b9-555f1d216dc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA33404',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 169847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA33404%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [auto1.es] INFO: Saving data for NA33404: {'auction_closing_time': 1774969807.0, 'created_time': 1773669801.150489, 'last_price_update_time': 1774868422.203822}
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA33404') HTTP/1.1" 204 0
2026-03-30 11:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: VG08794
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG08794%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [auto1.es] INFO: Scrape type for VG08794: 1
2026-03-30 11:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: EM34924
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM34924%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [auto1.es] INFO: Scrape type for EM34924: 1
2026-03-30 11:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: GT52927
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: ZV81401
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: SJ57569
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: PV91005
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: KX70446
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: JZ58453
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: HU27637
2026-03-30 11:00:22 [auto1.es] INFO: Found listing with ID: TP95319
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP95319%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [auto1.es] INFO: Scrape type for TP95319: 2
2026-03-30 11:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de3f0fa-c135-56cb-9bfd-4dcfa65364a8 with identifier: TP95319
2026-03-30 11:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de3f0fa-c135-56cb-9bfd-4dcfa65364a8 with scrape type 2
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de3f0fa-c135-56cb-9bfd-4dcfa65364a8 with scrape type 2
2026-03-30 11:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2de3f0fa-c135-56cb-9bfd-4dcfa65364a8, identifier: TP95319
2026-03-30 11:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2de3f0fa-c135-56cb-9bfd-4dcfa65364a8 with identifier: TP95319
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2de3f0fa-c135-56cb-9bfd-4dcfa65364a8 with identifier: TP95319
2026-03-30 11:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2de3f0fa-c135-56cb-9bfd-4dcfa65364a8 with identifier: TP95319 to the API
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:31:55Z',
 'fuel_type': 'petrol',
 'id': '2de3f0fa-c135-56cb-9bfd-4dcfa65364a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP95319',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 132687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2016}
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP95319%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [auto1.es] INFO: Saving data for TP95319: {'auction_closing_time': 1774971115.0, 'created_time': 1773127462.45803, 'last_price_update_time': 1774868423.517825}
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TP95319') HTTP/1.1" 204 0
2026-03-30 11:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:23 [auto1.es] INFO: Found listing with ID: TX75728
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX75728%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [auto1.es] INFO: Scrape type for TX75728: 1
2026-03-30 11:00:23 [auto1.es] INFO: Channel: 24h | Page: 1 | totalHits: 2190 | hits on page: 40
2026-03-30 11:00:23 [auto1.es] INFO: Found listing with ID: NL65956
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL65956%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [auto1.es] INFO: Scrape type for NL65956: 2
2026-03-30 11:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b500728d-ff3d-51eb-84f6-c72e41661ee8 with identifier: NL65956
2026-03-30 11:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b500728d-ff3d-51eb-84f6-c72e41661ee8 with scrape type 2
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b500728d-ff3d-51eb-84f6-c72e41661ee8 with scrape type 2
2026-03-30 11:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b500728d-ff3d-51eb-84f6-c72e41661ee8, identifier: NL65956
2026-03-30 11:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b500728d-ff3d-51eb-84f6-c72e41661ee8 with identifier: NL65956
2026-03-30 11:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b500728d-ff3d-51eb-84f6-c72e41661ee8 with identifier: NL65956
2026-03-30 11:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b500728d-ff3d-51eb-84f6-c72e41661ee8 with identifier: NL65956 to the API
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:47:09Z',
 'fuel_type': 'diesel',
 'id': 'b500728d-ff3d-51eb-84f6-c72e41661ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL65956',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 389068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-12',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL65956%27 HTTP/1.1" 200 None
2026-03-30 11:00:26 [auto1.es] INFO: Saving data for NL65956: {'auction_closing_time': 1774972029.0, 'created_time': 1773129421.513818, 'last_price_update_time': 1774868426.429498}
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NL65956') HTTP/1.1" 204 0
2026-03-30 11:00:26 [auto1.es] INFO: Found listing with ID: YW75057
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW75057%27 HTTP/1.1" 200 None
2026-03-30 11:00:26 [auto1.es] INFO: Scrape type for YW75057: 0
2026-03-30 11:00:26 [auto1.es] INFO: Found listing with ID: MP93470
2026-03-30 11:00:26 [auto1.es] INFO: Found listing with ID: NS19372
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS19372%27 HTTP/1.1" 200 None
2026-03-30 11:00:26 [auto1.es] INFO: Scrape type for NS19372: 0
2026-03-30 11:00:26 [auto1.es] INFO: Found listing with ID: SU99027
2026-03-30 11:00:26 [auto1.es] INFO: Found listing with ID: TS87015
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS87015%27 HTTP/1.1" 200 None
2026-03-30 11:00:26 [auto1.es] INFO: Scrape type for TS87015: 0
2026-03-30 11:00:26 [auto1.es] INFO: Found listing with ID: MP75885
2026-03-30 11:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:26 [auto1.es] INFO: Found listing with ID: FD15561
2026-03-30 11:00:26 [auto1.es] INFO: Found listing with ID: LH92168
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH92168%27 HTTP/1.1" 200 None
2026-03-30 11:00:26 [auto1.es] INFO: Scrape type for LH92168: 2
2026-03-30 11:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb0cd0fb-1117-5791-9d2a-2604c515cbb1 with identifier: LH92168
2026-03-30 11:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb0cd0fb-1117-5791-9d2a-2604c515cbb1 with scrape type 2
2026-03-30 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb0cd0fb-1117-5791-9d2a-2604c515cbb1 with scrape type 2
2026-03-30 11:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb0cd0fb-1117-5791-9d2a-2604c515cbb1, identifier: LH92168
2026-03-30 11:00:26 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/MP75885/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 11:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb0cd0fb-1117-5791-9d2a-2604c515cbb1 with identifier: LH92168
2026-03-30 11:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb0cd0fb-1117-5791-9d2a-2604c515cbb1 with identifier: LH92168
2026-03-30 11:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bb0cd0fb-1117-5791-9d2a-2604c515cbb1 with identifier: LH92168 to the API
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:03:32Z',
 'fuel_type': 'petrol',
 'id': 'bb0cd0fb-1117-5791-9d2a-2604c515cbb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH92168',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 48708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-13',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 e-THP GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH92168%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.es] INFO: Saving data for LH92168: {'auction_closing_time': 1774969412.0, 'created_time': 1774296069.463397, 'last_price_update_time': 1774868427.90262}
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LH92168') HTTP/1.1" 204 0
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: UL16630
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: PG13200
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: DF86538
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: PH25180
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: GJ97724
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ97724%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.es] INFO: Scrape type for GJ97724: 0
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: NG43974
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: PR99923
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: PH51159
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: MV24721
2026-03-30 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV24721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL41759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: YA78719
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: GB26165
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB26165%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.es] INFO: Scrape type for GB26165: 1
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: RL41759
2026-03-30 11:00:27 [auto1.es] INFO: Found listing with ID: GS28595
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS28595%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.es] INFO: Scrape type for GS28595: 1
2026-03-30 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP75885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:28 [auto1.es] INFO: Found listing with ID: PK44765
2026-03-30 11:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:28 [auto1.es] INFO: Found listing with ID: YN14059
2026-03-30 11:00:28 [auto1.es] INFO: Found listing with ID: JS29951
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS29951%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.es] INFO: Scrape type for JS29951: 1
2026-03-30 11:00:28 [auto1.es] INFO: Found listing with ID: JN78830
2026-03-30 11:00:28 [auto1.es] INFO: Found listing with ID: NA33404
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA33404%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.es] INFO: Scrape type for NA33404: 0
2026-03-30 11:00:28 [auto1.es] INFO: Found listing with ID: VG08794
2026-03-30 11:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:28 [auto1.es] INFO: Found listing with ID: VH94950
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH94950%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.es] INFO: Scrape type for VH94950: 2
2026-03-30 11:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c267eb3a-5148-522b-8f04-b618d44993a6 with identifier: VH94950
2026-03-30 11:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c267eb3a-5148-522b-8f04-b618d44993a6 with scrape type 2
2026-03-30 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c267eb3a-5148-522b-8f04-b618d44993a6 with scrape type 2
2026-03-30 11:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c267eb3a-5148-522b-8f04-b618d44993a6, identifier: VH94950
2026-03-30 11:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c267eb3a-5148-522b-8f04-b618d44993a6 with identifier: VH94950
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 11:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c267eb3a-5148-522b-8f04-b618d44993a6 with identifier: VH94950
2026-03-30 11:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c267eb3a-5148-522b-8f04-b618d44993a6 with identifier: VH94950 to the API
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:50:09Z',
 'fuel_type': 'diesel',
 'id': 'c267eb3a-5148-522b-8f04-b618d44993a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH94950',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 179883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-24',
 'seller_name': None,
 'title': 'Seat Altea 2.0 TDI 4Kids Style',
 'transmission': 'manual',
 'trim': '4Kids Style',
 'year': 2013}
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH94950%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.es] INFO: Saving data for VH94950: {'auction_closing_time': 1774972209.0, 'created_time': 1774263656.435898, 'last_price_update_time': 1774868430.954465}
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VH94950') HTTP/1.1" 204 0
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: EM34924
2026-03-30 11:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: MB90755
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: GT52927
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: ZV81401
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: SJ57569
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: PV91005
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: KX70446
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: JZ58453
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: HU27637
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: TP95319
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP95319%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.es] INFO: Scrape type for TP95319: 0
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: TX75728
2026-03-30 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK44765/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: NL65956
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL65956%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.es] INFO: Scrape type for NL65956: 0
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: FD15561
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: LH92168
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH92168%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.es] INFO: Scrape type for LH92168: 0
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: YA78719
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: GB26165
2026-03-30 11:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: GS28595
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: YN14059
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: JS29951
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: VH94950
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH94950%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.es] INFO: Scrape type for VH94950: 0
2026-03-30 11:00:31 [auto1.es] INFO: Found listing with ID: MB90755
2026-03-30 11:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX75728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM34924/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB26165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS29951/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS28595/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP75885> (referer: https://www.auto1.com/v1/car-details-view/MP75885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60dff873-4cdd-5c88-8861-50193062a871 with identifier: MP75885
2026-03-30 11:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60dff873-4cdd-5c88-8861-50193062a871 with scrape type 1
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_40dbd07f5cccc1606ea920b0ce3e15b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_40dbd07f5cccc1606ea920b0ce3e15b1.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_c022174cff8a7e25e1510753adc32c60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_c022174cff8a7e25e1510753adc32c60.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_d37bf09e9889c29f1c6204029ce5a8ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_d37bf09e9889c29f1c6204029ce5a8ae.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_a6abc2497cc43307eca3d3fe69ae00e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_a6abc2497cc43307eca3d3fe69ae00e6.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_2e6d4cd6eaec8dc90519893b2924bde3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_2e6d4cd6eaec8dc90519893b2924bde3.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_d959d698f0a1cc607537d2a6580ca3ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_d959d698f0a1cc607537d2a6580ca3ae.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_2a85494caba4bb16d736d7086da35c22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_2a85494caba4bb16d736d7086da35c22.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_f92f0bb65b199e1898400739e6011e71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_f92f0bb65b199e1898400739e6011e71.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_8d60b7e693cfc00ca72fe0a04ff5e984.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_8d60b7e693cfc00ca72fe0a04ff5e984.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_6acfa4c67b65eafd25d64e42b39d55b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_6acfa4c67b65eafd25d64e42b39d55b5.jpg not downloaded yet
2026-03-30 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV24721> (referer: https://www.auto1.com/v1/car-details-view/MV24721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_40dbd07f5cccc1606ea920b0ce3e15b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK44765> (referer: https://www.auto1.com/v1/car-details-view/PK44765/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ac82050-73a6-5e7f-a6d5-318b8db76170 with identifier: MV24721
2026-03-30 11:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac82050-73a6-5e7f-a6d5-318b8db76170 with scrape type 1
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_b2859022421c7f84b7c349eb5de10546.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b2859022421c7f84b7c349eb5de10546.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_6ffd1f07e5919e326242510a9a968b41.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_6ffd1f07e5919e326242510a9a968b41.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_0d90654546187b4d2c53977f9e83a7e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_0d90654546187b4d2c53977f9e83a7e0.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_00b9eed108acf00cd970883e8599528f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_00b9eed108acf00cd970883e8599528f.jpg not downloaded yet
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_bd5b4dd9d95ab7b7679318624a1791eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_bd5b4dd9d95ab7b7679318624a1791eb.jpg not downloaded yet
2026-03-30 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_2e6d4cd6eaec8dc90519893b2924bde3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_b3c5d9d3ab88e029fdc2ed363f786b2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b3c5d9d3ab88e029fdc2ed363f786b2c.jpg not downloaded yet
2026-03-30 11:00:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 11:00:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 11:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f458d0>
2026-03-30 11:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_40dbd07f5cccc1606ea920b0ce3e15b1.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_40dbd07f5cccc1606ea920b0ce3e15b1.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab1a4d30-3a8e-5915-9422-d29df558c266 with identifier: PK44765
2026-03-30 11:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab1a4d30-3a8e-5915-9422-d29df558c266 with scrape type 1
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ab1a4d30-3a8e-5915-9422-d29df558c266
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_bb8ede676c45adc32ecb19c8d1ae6c29.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_bb8ede676c45adc32ecb19c8d1ae6c29.jpg not downloaded yet
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_6510614aeb4abf65758a06a2d289621c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_6510614aeb4abf65758a06a2d289621c.jpg not downloaded yet
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_6acfa4c67b65eafd25d64e42b39d55b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_a6abc2497cc43307eca3d3fe69ae00e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_c022174cff8a7e25e1510753adc32c60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_90e383ec857b74387186c7ec49559362.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_90e383ec857b74387186c7ec49559362.jpg not downloaded yet
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_8d60b7e693cfc00ca72fe0a04ff5e984.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_d37bf09e9889c29f1c6204029ce5a8ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_d959d698f0a1cc607537d2a6580ca3ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_9d2c0ab620a31f7acda6fb6e2e404268.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_9d2c0ab620a31f7acda6fb6e2e404268.jpg not downloaded yet
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM34924> (referer: https://www.auto1.com/v1/car-details-view/EM34924/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f14790>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_2e6d4cd6eaec8dc90519893b2924bde3.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_2e6d4cd6eaec8dc90519893b2924bde3.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_eff04eacfe6f8607dfa3b5956fe0cdca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_eff04eacfe6f8607dfa3b5956fe0cdca.jpg not downloaded yet
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_bd5b4dd9d95ab7b7679318624a1791eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_cc9bd7e014aa1a976087ad10799a48fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_cc9bd7e014aa1a976087ad10799a48fe.jpg not downloaded yet
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_8d57d37c857823cab1689e360f4fb647.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_8d57d37c857823cab1689e360f4fb647.jpg not downloaded yet
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb661ba90>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_6acfa4c67b65eafd25d64e42b39d55b5.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_6acfa4c67b65eafd25d64e42b39d55b5.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_b719e6c059d4d5673560410c2e414093.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b719e6c059d4d5673560410c2e414093.jpg not downloaded yet
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_00b9eed108acf00cd970883e8599528f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b3c5d9d3ab88e029fdc2ed363f786b2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_6ffd1f07e5919e326242510a9a968b41.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_0d90654546187b4d2c53977f9e83a7e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_bb8ede676c45adc32ecb19c8d1ae6c29.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_2821a1c9d079d37bb54b4fcb2bf09427.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_2821a1c9d079d37bb54b4fcb2bf09427.jpg not downloaded yet
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc11cf10>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_a6abc2497cc43307eca3d3fe69ae00e6.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_a6abc2497cc43307eca3d3fe69ae00e6.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc105650>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_c022174cff8a7e25e1510753adc32c60.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_c022174cff8a7e25e1510753adc32c60.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662d250>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_8d60b7e693cfc00ca72fe0a04ff5e984.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_8d60b7e693cfc00ca72fe0a04ff5e984.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb660eb90>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_d37bf09e9889c29f1c6204029ce5a8ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_d37bf09e9889c29f1c6204029ce5a8ae.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6640150>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_d959d698f0a1cc607537d2a6580ca3ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_d959d698f0a1cc607537d2a6580ca3ae.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78d150a4-3c73-5121-a7e1-8fccad852541 with identifier: EM34924
2026-03-30 11:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d150a4-3c73-5121-a7e1-8fccad852541 with scrape type 1
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_0110f8df82db60b296da14e80c9159e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_0110f8df82db60b296da14e80c9159e0.jpg not downloaded yet
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_f92f0bb65b199e1898400739e6011e71.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_ab6de2cad29cd3ef9de4867189635e6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_ab6de2cad29cd3ef9de4867189635e6e.jpg not downloaded yet
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB26165> (referer: https://www.auto1.com/v1/car-details-view/GB26165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_6510614aeb4abf65758a06a2d289621c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_90e383ec857b74387186c7ec49559362.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_a700c5af51b4f2a44c297db9968107d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_a700c5af51b4f2a44c297db9968107d7.jpg not downloaded yet
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c9f50>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_bd5b4dd9d95ab7b7679318624a1791eb.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_bd5b4dd9d95ab7b7679318624a1791eb.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66dc150>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_00b9eed108acf00cd970883e8599528f.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_00b9eed108acf00cd970883e8599528f.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6563a90>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_b3c5d9d3ab88e029fdc2ed363f786b2c.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b3c5d9d3ab88e029fdc2ed363f786b2c.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c8ad0>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_6ffd1f07e5919e326242510a9a968b41.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_6ffd1f07e5919e326242510a9a968b41.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66ad710>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_0d90654546187b4d2c53977f9e83a7e0.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_0d90654546187b4d2c53977f9e83a7e0.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66cb610>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_bb8ede676c45adc32ecb19c8d1ae6c29.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_bb8ede676c45adc32ecb19c8d1ae6c29.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab1a4d30-3a8e-5915-9422-d29df558c266
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_9d2c0ab620a31f7acda6fb6e2e404268.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_1bbd3a2085ad9ab006ea0daa83ba09dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_1bbd3a2085ad9ab006ea0daa83ba09dd.jpg not downloaded yet
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_cc9bd7e014aa1a976087ad10799a48fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b719e6c059d4d5673560410c2e414093.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_eff04eacfe6f8607dfa3b5956fe0cdca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b2859022421c7f84b7c349eb5de10546.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_8d57d37c857823cab1689e360f4fb647.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_2aad331cb4d4ed538b2d8ad6dfa70c37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_2aad331cb4d4ed538b2d8ad6dfa70c37.jpg not downloaded yet
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS28595> (referer: https://www.auto1.com/v1/car-details-view/GS28595/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6561010>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_f92f0bb65b199e1898400739e6011e71.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_f92f0bb65b199e1898400739e6011e71.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb46a3d-21be-5605-a950-ebde2d2a5ad8 with identifier: GB26165
2026-03-30 11:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8 with scrape type 1
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_6f7e9304ccbea8d057eabfc42410aed2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_6f7e9304ccbea8d057eabfc42410aed2.jpg not downloaded yet
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb657b690>
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_6510614aeb4abf65758a06a2d289621c.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_6510614aeb4abf65758a06a2d289621c.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65b7cd0>
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_90e383ec857b74387186c7ec49559362.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_90e383ec857b74387186c7ec49559362.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab1a4d30-3a8e-5915-9422-d29df558c266
2026-03-30 11:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_2821a1c9d079d37bb54b4fcb2bf09427.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_85b041cb3f82a83fe12c6fad4d8afc6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_85b041cb3f82a83fe12c6fad4d8afc6c.jpg not downloaded yet
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_f4260376cf0eb7f755a2113ad121451b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_f4260376cf0eb7f755a2113ad121451b.jpg not downloaded yet
2026-03-30 11:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_ab6de2cad29cd3ef9de4867189635e6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65b5dd0>
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_9d2c0ab620a31f7acda6fb6e2e404268.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_9d2c0ab620a31f7acda6fb6e2e404268.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6663c50>
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_cc9bd7e014aa1a976087ad10799a48fe.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_cc9bd7e014aa1a976087ad10799a48fe.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6693710>
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_b719e6c059d4d5673560410c2e414093.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b719e6c059d4d5673560410c2e414093.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6664390>
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_eff04eacfe6f8607dfa3b5956fe0cdca.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_eff04eacfe6f8607dfa3b5956fe0cdca.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab1a4d30-3a8e-5915-9422-d29df558c266
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6692150>
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1d%252Fd21d2619790a3fc4dadcec6593ec06c6%252Fpa%252FMV24721_b2859022421c7f84b7c349eb5de10546.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b2859022421c7f84b7c349eb5de10546.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ac82050-73a6-5e7f-a6d5-318b8db76170
2026-03-30 11:00:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ac82050-73a6-5e7f-a6d5-318b8db76170, skipping ID generation
2026-03-30 11:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac82050-73a6-5e7f-a6d5-318b8db76170 with scrape type 1
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ac82050-73a6-5e7f-a6d5-318b8db76170 sending to next pipeline
2026-03-30 11:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ac82050-73a6-5e7f-a6d5-318b8db76170, identifier: MV24721
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66d00d0>
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_8d57d37c857823cab1689e360f4fb647.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_8d57d37c857823cab1689e360f4fb647.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab1a4d30-3a8e-5915-9422-d29df558c266
2026-03-30 11:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8ca41b4-79a4-56c9-928a-4a22a3cc1d74 with identifier: GS28595
2026-03-30 11:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74 with scrape type 1
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_eda7dbb1b74f524ccfe906bc4e5229bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_eda7dbb1b74f524ccfe906bc4e5229bb.jpg not downloaded yet
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_9d0b2eebc1394d06b01872d0e41b76c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_9d0b2eebc1394d06b01872d0e41b76c8.jpg not downloaded yet
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_5df85aa366e27cd72b6eb38ef35338a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_5df85aa366e27cd72b6eb38ef35338a1.jpg not downloaded yet
2026-03-30 11:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ac82050-73a6-5e7f-a6d5-318b8db76170 with identifier: MV24721
2026-03-30 11:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ac82050-73a6-5e7f-a6d5-318b8db76170 with identifier: MV24721
2026-03-30 11:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ac82050-73a6-5e7f-a6d5-318b8db76170 with identifier: MV24721 to the API
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b2859022421c7f84b7c349eb5de10546.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '3.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:45:44Z',
 'fuel_type': 'diesel',
 'id': '3ac82050-73a6-5e7f-a6d5-318b8db76170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV24721',
 'listing': 'auction',
 'location': 'ES, Granollers',
 'make': 'Chrysler',
 'model': '300 C',
 'odometer': 228044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b2859022421c7f84b7c349eb5de10546.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_6ffd1f07e5919e326242510a9a968b41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_0d90654546187b4d2c53977f9e83a7e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_00b9eed108acf00cd970883e8599528f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_bd5b4dd9d95ab7b7679318624a1791eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b3c5d9d3ab88e029fdc2ed363f786b2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_6510614aeb4abf65758a06a2d289621c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_9d2c0ab620a31f7acda6fb6e2e404268.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_cc9bd7e014aa1a976087ad10799a48fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac82050-73a6-5e7f-a6d5-318b8db76170/3ac82050-73a6-5e7f-a6d5-318b8db76170_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1d/d21d2619790a3fc4dadcec6593ec06c6/pa/MV24721_b719e6c059d4d5673560410c2e414093.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chrysler 300 C 3.0 CRD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV24721%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [auto1.es] INFO: Saving data for MV24721: {'created_time': 1774868436.37023, 'last_price_update_time': 1774868436.370244, 'auction_closing_time': 1774971944.0}
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MV24721') HTTP/1.1" 204 0
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_2a85494caba4bb16d736d7086da35c22.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_9d39c1f34270f35493b5e3fb1439b46c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_9d39c1f34270f35493b5e3fb1439b46c.jpg not downloaded yet
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_0110f8df82db60b296da14e80c9159e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_344042483c56391c58eff76af34d9447.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_344042483c56391c58eff76af34d9447.jpg not downloaded yet
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_c3666b2cfc096298bf34f7634a28b690.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_c3666b2cfc096298bf34f7634a28b690.jpg not downloaded yet
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL41759> (referer: https://www.auto1.com/v1/car-details-view/RL41759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fbae90>
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_2821a1c9d079d37bb54b4fcb2bf09427.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_2821a1c9d079d37bb54b4fcb2bf09427.jpg saved to cache
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab1a4d30-3a8e-5915-9422-d29df558c266
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6598f50>
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F2d%252F7f2da2b82cca451a4e62dba55195248b%252Fpa%252FPK44765_ab6de2cad29cd3ef9de4867189635e6e.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_ab6de2cad29cd3ef9de4867189635e6e.jpg saved to cache
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab1a4d30-3a8e-5915-9422-d29df558c266
2026-03-30 11:00:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab1a4d30-3a8e-5915-9422-d29df558c266, skipping ID generation
2026-03-30 11:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab1a4d30-3a8e-5915-9422-d29df558c266 with scrape type 1
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab1a4d30-3a8e-5915-9422-d29df558c266 sending to next pipeline
2026-03-30 11:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ab1a4d30-3a8e-5915-9422-d29df558c266, identifier: PK44765
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_1bbd3a2085ad9ab006ea0daa83ba09dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_bda04d5ced948b345990a0457daca5d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_bda04d5ced948b345990a0457daca5d0.jpg not downloaded yet
2026-03-30 11:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ab1a4d30-3a8e-5915-9422-d29df558c266 with identifier: PK44765
2026-03-30 11:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ab1a4d30-3a8e-5915-9422-d29df558c266 with identifier: PK44765
2026-03-30 11:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ab1a4d30-3a8e-5915-9422-d29df558c266 with identifier: PK44765 to the API
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_ab6de2cad29cd3ef9de4867189635e6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:58:29Z',
 'fuel_type': 'diesel',
 'id': 'ab1a4d30-3a8e-5915-9422-d29df558c266',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK44765',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'BMW',
 'model': '1er',
 'odometer': 208772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_bb8ede676c45adc32ecb19c8d1ae6c29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_90e383ec857b74387186c7ec49559362.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_eff04eacfe6f8607dfa3b5956fe0cdca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_8d57d37c857823cab1689e360f4fb647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_2821a1c9d079d37bb54b4fcb2bf09427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab1a4d30-3a8e-5915-9422-d29df558c266/ab1a4d30-3a8e-5915-9422-d29df558c266_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/2d/7f2da2b82cca451a4e62dba55195248b/pa/PK44765_ab6de2cad29cd3ef9de4867189635e6e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK44765%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.es] INFO: Saving data for PK44765: {'created_time': 1774868437.13683, 'last_price_update_time': 1774868437.136842, 'auction_closing_time': 1774972709.0}
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK44765') HTTP/1.1" 204 0
2026-03-30 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_a700c5af51b4f2a44c297db9968107d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_854a8f4bd82a5212fe38da5d42696f87.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_854a8f4bd82a5212fe38da5d42696f87.jpg not downloaded yet
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_860cef1be3e455305f9387ba62cb9245.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_860cef1be3e455305f9387ba62cb9245.jpg not downloaded yet
2026-03-30 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_6f7e9304ccbea8d057eabfc42410aed2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_f4260376cf0eb7f755a2113ad121451b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_62b4d9b838bd725d892500ac626a1e34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_62b4d9b838bd725d892500ac626a1e34.jpg not downloaded yet
2026-03-30 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX75728> (referer: https://www.auto1.com/v1/car-details-view/TX75728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc135450>
2026-03-30 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fcf%252F0acf41df2b7128a70c4cf1c4db4d254f%252Fpa%252FMP75885_2a85494caba4bb16d736d7086da35c22.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_2a85494caba4bb16d736d7086da35c22.jpg saved to cache
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60dff873-4cdd-5c88-8861-50193062a871
2026-03-30 11:00:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60dff873-4cdd-5c88-8861-50193062a871, skipping ID generation
2026-03-30 11:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60dff873-4cdd-5c88-8861-50193062a871 with scrape type 1
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60dff873-4cdd-5c88-8861-50193062a871 sending to next pipeline
2026-03-30 11:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60dff873-4cdd-5c88-8861-50193062a871, identifier: MP75885
2026-03-30 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc185690>
2026-03-30 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_0110f8df82db60b296da14e80c9159e0.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_0110f8df82db60b296da14e80c9159e0.jpg saved to cache
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d099f9e8-4db7-5950-ba77-1e6455188303 with identifier: RL41759
2026-03-30 11:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d099f9e8-4db7-5950-ba77-1e6455188303 with scrape type 1
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_ec93ee409146901ec49fbac547032c65.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_ec93ee409146901ec49fbac547032c65.jpg not downloaded yet
2026-03-30 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_eda7dbb1b74f524ccfe906bc4e5229bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_8948d89d8698914c47ea80512fb3a3a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_8948d89d8698914c47ea80512fb3a3a2.jpg not downloaded yet
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_e79f31b92bfe0c7a2f4b61e9090ab5e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_e79f31b92bfe0c7a2f4b61e9090ab5e4.jpg not downloaded yet
2026-03-30 11:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60dff873-4cdd-5c88-8861-50193062a871 with identifier: MP75885
2026-03-30 11:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60dff873-4cdd-5c88-8861-50193062a871 with identifier: MP75885
2026-03-30 11:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60dff873-4cdd-5c88-8861-50193062a871 with identifier: MP75885 to the API
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_2a85494caba4bb16d736d7086da35c22.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.3L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:16:17Z',
 'fuel_type': 'petrol',
 'id': '60dff873-4cdd-5c88-8861-50193062a871',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP75885',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 48694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_40dbd07f5cccc1606ea920b0ce3e15b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_c022174cff8a7e25e1510753adc32c60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_d37bf09e9889c29f1c6204029ce5a8ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_a6abc2497cc43307eca3d3fe69ae00e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_2e6d4cd6eaec8dc90519893b2924bde3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_d959d698f0a1cc607537d2a6580ca3ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_2a85494caba4bb16d736d7086da35c22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_f92f0bb65b199e1898400739e6011e71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_8d60b7e693cfc00ca72fe0a04ff5e984.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dff873-4cdd-5c88-8861-50193062a871/60dff873-4cdd-5c88-8861-50193062a871_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/cf/0acf41df2b7128a70c4cf1c4db4d254f/pa/MP75885_6acfa4c67b65eafd25d64e42b39d55b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-07-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 230 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP75885%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.es] INFO: Saving data for MP75885: {'created_time': 1774868438.162202, 'last_price_update_time': 1774868438.162214, 'auction_closing_time': 1774970177.0}
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MP75885') HTTP/1.1" 204 0
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_2aad331cb4d4ed538b2d8ad6dfa70c37.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_85b041cb3f82a83fe12c6fad4d8afc6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_5df85aa366e27cd72b6eb38ef35338a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_615e1bdaa95490dba8917949fd2b42ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_615e1bdaa95490dba8917949fd2b42ca.jpg not downloaded yet
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_9dc0c868055c4574a3c292675b8e9b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_9dc0c868055c4574a3c292675b8e9b0a.jpg not downloaded yet
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6602c90>
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_1bbd3a2085ad9ab006ea0daa83ba09dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_1bbd3a2085ad9ab006ea0daa83ba09dd.jpg saved to cache
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_9d39c1f34270f35493b5e3fb1439b46c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_cefff886227eb5a52a8bef8ab276aca0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_cefff886227eb5a52a8bef8ab276aca0.jpg not downloaded yet
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66be0d0>
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_a700c5af51b4f2a44c297db9968107d7.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_a700c5af51b4f2a44c297db9968107d7.jpg saved to cache
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6423a50>
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_6f7e9304ccbea8d057eabfc42410aed2.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_6f7e9304ccbea8d057eabfc42410aed2.jpg saved to cache
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6435f90>
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_f4260376cf0eb7f755a2113ad121451b.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_f4260376cf0eb7f755a2113ad121451b.jpg saved to cache
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8
2026-03-30 11:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fc1a51b-6fe0-5845-8d81-6ec1324a9559 with identifier: TX75728
2026-03-30 11:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559 with scrape type 1
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_c0f68ec1ee92bdeb5b37c89887657e95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_c0f68ec1ee92bdeb5b37c89887657e95.jpg not downloaded yet
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_9d0b2eebc1394d06b01872d0e41b76c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_6d4c7aeac25291c0a81e3e9d27a3786c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_6d4c7aeac25291c0a81e3e9d27a3786c.jpg not downloaded yet
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_3099694762a674492df61c33236dc621.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_3099694762a674492df61c33236dc621.jpg not downloaded yet
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_860cef1be3e455305f9387ba62cb9245.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_bda04d5ced948b345990a0457daca5d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_a57aaf155bae214c788928e5790be4cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_a57aaf155bae214c788928e5790be4cc.jpg not downloaded yet
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb640ab10>
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_eda7dbb1b74f524ccfe906bc4e5229bb.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_eda7dbb1b74f524ccfe906bc4e5229bb.jpg saved to cache
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65cb9d0>
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_2aad331cb4d4ed538b2d8ad6dfa70c37.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_2aad331cb4d4ed538b2d8ad6dfa70c37.jpg saved to cache
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb650d710>
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_85b041cb3f82a83fe12c6fad4d8afc6c.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_85b041cb3f82a83fe12c6fad4d8afc6c.jpg saved to cache
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6587750>
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_5df85aa366e27cd72b6eb38ef35338a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_5df85aa366e27cd72b6eb38ef35338a1.jpg saved to cache
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_c3666b2cfc096298bf34f7634a28b690.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_0be8eed13f4c59432295790319f6f658.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_0be8eed13f4c59432295790319f6f658.jpg not downloaded yet
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_a7f5ade1a27a62956812cbfba229541e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_a7f5ade1a27a62956812cbfba229541e.jpg not downloaded yet
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_62b4d9b838bd725d892500ac626a1e34.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_ec93ee409146901ec49fbac547032c65.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_4dca79c717d60ffa9fc1e5214af6c994.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_4dca79c717d60ffa9fc1e5214af6c994.jpg not downloaded yet
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_344042483c56391c58eff76af34d9447.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_80a3153181e9d0324e9019e5e4bba13e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_80a3153181e9d0324e9019e5e4bba13e.jpg not downloaded yet
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_d972f968f93087fe0df14051f6a7dfdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_d972f968f93087fe0df14051f6a7dfdd.jpg not downloaded yet
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb641b910>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_9d39c1f34270f35493b5e3fb1439b46c.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_9d39c1f34270f35493b5e3fb1439b46c.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6663790>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_9d0b2eebc1394d06b01872d0e41b76c8.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_9d0b2eebc1394d06b01872d0e41b76c8.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f8f510>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_860cef1be3e455305f9387ba62cb9245.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_860cef1be3e455305f9387ba62cb9245.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb64564d0>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_bda04d5ced948b345990a0457daca5d0.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_bda04d5ced948b345990a0457daca5d0.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_854a8f4bd82a5212fe38da5d42696f87.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_cefff886227eb5a52a8bef8ab276aca0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_628d1ed3ed776636ddf8ab08cb99fa2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_628d1ed3ed776636ddf8ab08cb99fa2f.jpg not downloaded yet
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_8948d89d8698914c47ea80512fb3a3a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_c0f68ec1ee92bdeb5b37c89887657e95.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_d62207f594e56dc5f56f719dbc6e4722.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_d62207f594e56dc5f56f719dbc6e4722.jpg not downloaded yet
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_8a2fe2f43df120ea90500a6ff1656e73.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_8a2fe2f43df120ea90500a6ff1656e73.jpg not downloaded yet
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_3f7e47c935fb569dfa2e782419de6083.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_3f7e47c935fb569dfa2e782419de6083.jpg not downloaded yet
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb668fc90>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_c3666b2cfc096298bf34f7634a28b690.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_c3666b2cfc096298bf34f7634a28b690.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6426590>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_62b4d9b838bd725d892500ac626a1e34.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_62b4d9b838bd725d892500ac626a1e34.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66aad10>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_ec93ee409146901ec49fbac547032c65.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_ec93ee409146901ec49fbac547032c65.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6692750>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_344042483c56391c58eff76af34d9447.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_344042483c56391c58eff76af34d9447.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_e79f31b92bfe0c7a2f4b61e9090ab5e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_17f8eb2a669798e8d83cc7b64e659980.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_17f8eb2a669798e8d83cc7b64e659980.jpg not downloaded yet
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_44bb6715e78c09e7c999d944e7b34939.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_44bb6715e78c09e7c999d944e7b34939.jpg not downloaded yet
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_a7f5ade1a27a62956812cbfba229541e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_3099694762a674492df61c33236dc621.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_d286799998d260d2729b784c03200709.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_d286799998d260d2729b784c03200709.jpg not downloaded yet
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_615e1bdaa95490dba8917949fd2b42ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_6d4c7aeac25291c0a81e3e9d27a3786c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_9dc0c868055c4574a3c292675b8e9b0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_a57aaf155bae214c788928e5790be4cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_0be8eed13f4c59432295790319f6f658.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_105242248ebb6bf4052a495709dcdbfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_105242248ebb6bf4052a495709dcdbfa.jpg not downloaded yet
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c3c90>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_854a8f4bd82a5212fe38da5d42696f87.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_854a8f4bd82a5212fe38da5d42696f87.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c4810>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_cefff886227eb5a52a8bef8ab276aca0.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_cefff886227eb5a52a8bef8ab276aca0.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f8fb10>
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb447204558987a1d3af4e96844e16%252Fpa%252FEM34924_8948d89d8698914c47ea80512fb3a3a2.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_8948d89d8698914c47ea80512fb3a3a2.jpg saved to cache
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78d150a4-3c73-5121-a7e1-8fccad852541
2026-03-30 11:00:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78d150a4-3c73-5121-a7e1-8fccad852541, skipping ID generation
2026-03-30 11:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d150a4-3c73-5121-a7e1-8fccad852541 with scrape type 1
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78d150a4-3c73-5121-a7e1-8fccad852541 sending to next pipeline
2026-03-30 11:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78d150a4-3c73-5121-a7e1-8fccad852541, identifier: EM34924
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66a6610>
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_c0f68ec1ee92bdeb5b37c89887657e95.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_c0f68ec1ee92bdeb5b37c89887657e95.jpg saved to cache
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_3f7c5fdb5d27cfd6e6686dd0d3e74101.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_3f7c5fdb5d27cfd6e6686dd0d3e74101.jpg not downloaded yet
2026-03-30 11:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78d150a4-3c73-5121-a7e1-8fccad852541 with identifier: EM34924
2026-03-30 11:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78d150a4-3c73-5121-a7e1-8fccad852541 with identifier: EM34924
2026-03-30 11:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 78d150a4-3c73-5121-a7e1-8fccad852541 with identifier: EM34924 to the API
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_8948d89d8698914c47ea80512fb3a3a2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:19Z',
 'fuel_type': 'diesel',
 'id': '78d150a4-3c73-5121-a7e1-8fccad852541',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM34924',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 8076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270718,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_0110f8df82db60b296da14e80c9159e0.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270718,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_a700c5af51b4f2a44c297db9968107d7.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212606,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_1bbd3a2085ad9ab006ea0daa83ba09dd.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219321,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_2aad331cb4d4ed538b2d8ad6dfa70c37.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219321,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_85b041cb3f82a83fe12c6fad4d8afc6c.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247570,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_9d0b2eebc1394d06b01872d0e41b76c8.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270718,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_344042483c56391c58eff76af34d9447.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270718,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_854a8f4bd82a5212fe38da5d42696f87.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184696,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_8948d89d8698914c47ea80512fb3a3a2.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d150a4-3c73-5121-a7e1-8fccad852541/78d150a4-3c73-5121-a7e1-8fccad852541_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb447204558987a1d3af4e96844e16/pa/EM34924_cefff886227eb5a52a8bef8ab276aca0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2025}
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM34924%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [auto1.es] INFO: Saving data for EM34924: {'created_time': 1774868440.75744, 'last_price_update_time': 1774868440.757453, 'auction_closing_time': 1774971259.0}
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EM34924') HTTP/1.1" 204 0
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_8a2fe2f43df120ea90500a6ff1656e73.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_3f7e47c935fb569dfa2e782419de6083.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_44bb6715e78c09e7c999d944e7b34939.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_4dca79c717d60ffa9fc1e5214af6c994.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_d972f968f93087fe0df14051f6a7dfdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_80a3153181e9d0324e9019e5e4bba13e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_628d1ed3ed776636ddf8ab08cb99fa2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_d62207f594e56dc5f56f719dbc6e4722.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_edbecf00956010514b9ddacf033b776c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_edbecf00956010514b9ddacf033b776c.jpg not downloaded yet
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb668ef10>
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F97%252F8897f461b92f984cb727907895336542%252Fpa%252FGB26165_e79f31b92bfe0c7a2f4b61e9090ab5e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_e79f31b92bfe0c7a2f4b61e9090ab5e4.jpg saved to cache
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8
2026-03-30 11:00:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfb46a3d-21be-5605-a950-ebde2d2a5ad8, skipping ID generation
2026-03-30 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8 with scrape type 1
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfb46a3d-21be-5605-a950-ebde2d2a5ad8 sending to next pipeline
2026-03-30 11:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cfb46a3d-21be-5605-a950-ebde2d2a5ad8, identifier: GB26165
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb649abd0>
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_a7f5ade1a27a62956812cbfba229541e.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_a7f5ade1a27a62956812cbfba229541e.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6517d90>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_3099694762a674492df61c33236dc621.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_3099694762a674492df61c33236dc621.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fcbc10>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_615e1bdaa95490dba8917949fd2b42ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_615e1bdaa95490dba8917949fd2b42ca.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb661a750>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_6d4c7aeac25291c0a81e3e9d27a3786c.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_6d4c7aeac25291c0a81e3e9d27a3786c.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc6b0ad0>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_9dc0c868055c4574a3c292675b8e9b0a.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_9dc0c868055c4574a3c292675b8e9b0a.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f42790>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_a57aaf155bae214c788928e5790be4cc.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_a57aaf155bae214c788928e5790be4cc.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc11fa50>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_0be8eed13f4c59432295790319f6f658.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_0be8eed13f4c59432295790319f6f658.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cfb46a3d-21be-5605-a950-ebde2d2a5ad8 with identifier: GB26165
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 11:00:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cfb46a3d-21be-5605-a950-ebde2d2a5ad8 with identifier: GB26165
2026-03-30 11:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cfb46a3d-21be-5605-a950-ebde2d2a5ad8 with identifier: GB26165 to the API
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_e79f31b92bfe0c7a2f4b61e9090ab5e4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-31T15:18:15Z',
 'fuel_type': 'petrol',
 'id': 'cfb46a3d-21be-5605-a950-ebde2d2a5ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB26165',
 'listing': 'auction',
 'location': 'ES, Ourense',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 172993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_6f7e9304ccbea8d057eabfc42410aed2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_f4260376cf0eb7f755a2113ad121451b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_5df85aa366e27cd72b6eb38ef35338a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_c3666b2cfc096298bf34f7634a28b690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_860cef1be3e455305f9387ba62cb9245.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb46a3d-21be-5605-a950-ebde2d2a5ad8/cfb46a3d-21be-5605-a950-ebde2d2a5ad8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/97/8897f461b92f984cb727907895336542/pa/GB26165_e79f31b92bfe0c7a2f4b61e9090ab5e4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB26165%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.es] INFO: Saving data for GB26165: {'created_time': 1774868441.824801, 'last_price_update_time': 1774868441.82482, 'auction_closing_time': 1774970295.0}
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GB26165') HTTP/1.1" 204 0
2026-03-30 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_d286799998d260d2729b784c03200709.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_17f8eb2a669798e8d83cc7b64e659980.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_105242248ebb6bf4052a495709dcdbfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd378350>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_8a2fe2f43df120ea90500a6ff1656e73.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_8a2fe2f43df120ea90500a6ff1656e73.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb649bf10>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_3f7e47c935fb569dfa2e782419de6083.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_3f7e47c935fb569dfa2e782419de6083.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6619410>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_44bb6715e78c09e7c999d944e7b34939.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_44bb6715e78c09e7c999d944e7b34939.jpg saved to cache
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6426f10>
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_4dca79c717d60ffa9fc1e5214af6c994.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_4dca79c717d60ffa9fc1e5214af6c994.jpg saved to cache
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb656fc50>
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_d972f968f93087fe0df14051f6a7dfdd.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_d972f968f93087fe0df14051f6a7dfdd.jpg saved to cache
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6618590>
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_80a3153181e9d0324e9019e5e4bba13e.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_80a3153181e9d0324e9019e5e4bba13e.jpg saved to cache
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6585290>
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_628d1ed3ed776636ddf8ab08cb99fa2f.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_628d1ed3ed776636ddf8ab08cb99fa2f.jpg saved to cache
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6425fd0>
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_d62207f594e56dc5f56f719dbc6e4722.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_d62207f594e56dc5f56f719dbc6e4722.jpg saved to cache
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_3f7c5fdb5d27cfd6e6686dd0d3e74101.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_edbecf00956010514b9ddacf033b776c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f4dfd0>
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F93787efac331950b5a7dd84a6bd57e1c%252Fpa%252FTX75728_d286799998d260d2729b784c03200709.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_d286799998d260d2729b784c03200709.jpg saved to cache
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559
2026-03-30 11:00:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fc1a51b-6fe0-5845-8d81-6ec1324a9559, skipping ID generation
2026-03-30 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559 with scrape type 1
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fc1a51b-6fe0-5845-8d81-6ec1324a9559 sending to next pipeline
2026-03-30 11:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5fc1a51b-6fe0-5845-8d81-6ec1324a9559, identifier: TX75728
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66be110>
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F70%252F5770ee6b95a47019e818af1b4cbd51a6%252Fpa%252FGS28595_17f8eb2a669798e8d83cc7b64e659980.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_17f8eb2a669798e8d83cc7b64e659980.jpg saved to cache
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74
2026-03-30 11:00:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8ca41b4-79a4-56c9-928a-4a22a3cc1d74, skipping ID generation
2026-03-30 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74 with scrape type 1
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8ca41b4-79a4-56c9-928a-4a22a3cc1d74 sending to next pipeline
2026-03-30 11:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8ca41b4-79a4-56c9-928a-4a22a3cc1d74, identifier: GS28595
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc12ae10>
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_105242248ebb6bf4052a495709dcdbfa.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_105242248ebb6bf4052a495709dcdbfa.jpg saved to cache
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5fc1a51b-6fe0-5845-8d81-6ec1324a9559 with identifier: TX75728
2026-03-30 11:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5fc1a51b-6fe0-5845-8d81-6ec1324a9559 with identifier: TX75728
2026-03-30 11:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5fc1a51b-6fe0-5845-8d81-6ec1324a9559 with identifier: TX75728 to the API
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_d286799998d260d2729b784c03200709.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:28:59Z',
 'fuel_type': 'diesel',
 'id': '5fc1a51b-6fe0-5845-8d81-6ec1324a9559',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX75728',
 'listing': 'auction',
 'location': 'ES, Manresa',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 199304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_c0f68ec1ee92bdeb5b37c89887657e95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_a57aaf155bae214c788928e5790be4cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_4dca79c717d60ffa9fc1e5214af6c994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_628d1ed3ed776636ddf8ab08cb99fa2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_3f7e47c935fb569dfa2e782419de6083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc1a51b-6fe0-5845-8d81-6ec1324a9559/5fc1a51b-6fe0-5845-8d81-6ec1324a9559_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/78/93787efac331950b5a7dd84a6bd57e1c/pa/TX75728_d286799998d260d2729b784c03200709.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX75728%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.es] INFO: Saving data for TX75728: {'created_time': 1774868443.146546, 'last_price_update_time': 1774868443.146559, 'auction_closing_time': 1774970939.0}
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TX75728') HTTP/1.1" 204 0
2026-03-30 11:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8ca41b4-79a4-56c9-928a-4a22a3cc1d74 with identifier: GS28595
2026-03-30 11:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8ca41b4-79a4-56c9-928a-4a22a3cc1d74 with identifier: GS28595
2026-03-30 11:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8ca41b4-79a4-56c9-928a-4a22a3cc1d74 with identifier: GS28595 to the API
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_17f8eb2a669798e8d83cc7b64e659980.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:05:32Z',
 'fuel_type': 'diesel',
 'id': 'c8ca41b4-79a4-56c9-928a-4a22a3cc1d74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS28595',
 'listing': 'auction',
 'location': 'ES, Vilagarcía de Arousa',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 340305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_eda7dbb1b74f524ccfe906bc4e5229bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_9d39c1f34270f35493b5e3fb1439b46c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_bda04d5ced948b345990a0457daca5d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_62b4d9b838bd725d892500ac626a1e34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_615e1bdaa95490dba8917949fd2b42ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_6d4c7aeac25291c0a81e3e9d27a3786c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_0be8eed13f4c59432295790319f6f658.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_80a3153181e9d0324e9019e5e4bba13e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_d62207f594e56dc5f56f719dbc6e4722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8ca41b4-79a4-56c9-928a-4a22a3cc1d74/c8ca41b4-79a4-56c9-928a-4a22a3cc1d74_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/70/5770ee6b95a47019e818af1b4cbd51a6/pa/GS28595_17f8eb2a669798e8d83cc7b64e659980.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 220 CDI Standard',
 'transmission': 'automatic',
 'trim': 'Standard',
 'year': 2013}
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS28595%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.es] INFO: Saving data for GS28595: {'created_time': 1774868443.544866, 'last_price_update_time': 1774868443.544878, 'auction_closing_time': 1774969532.0}
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GS28595') HTTP/1.1" 204 0
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f18610>
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_3f7c5fdb5d27cfd6e6686dd0d3e74101.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_3f7c5fdb5d27cfd6e6686dd0d3e74101.jpg saved to cache
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:43 [auto1.es] INFO: Channel: 24h | Page: 2 | totalHits: 2192 | hits on page: 40
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fc0d10>
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F59%252F915910e1cc6609713e52afe7486ca138%252Fpa%252FRL41759_edbecf00956010514b9ddacf033b776c.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_edbecf00956010514b9ddacf033b776c.jpg saved to cache
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d099f9e8-4db7-5950-ba77-1e6455188303
2026-03-30 11:00:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d099f9e8-4db7-5950-ba77-1e6455188303, skipping ID generation
2026-03-30 11:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d099f9e8-4db7-5950-ba77-1e6455188303 with scrape type 1
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d099f9e8-4db7-5950-ba77-1e6455188303 sending to next pipeline
2026-03-30 11:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d099f9e8-4db7-5950-ba77-1e6455188303, identifier: RL41759
2026-03-30 11:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d099f9e8-4db7-5950-ba77-1e6455188303 with identifier: RL41759
2026-03-30 11:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d099f9e8-4db7-5950-ba77-1e6455188303 with identifier: RL41759
2026-03-30 11:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d099f9e8-4db7-5950-ba77-1e6455188303 with identifier: RL41759 to the API
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_edbecf00956010514b9ddacf033b776c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:05:39Z',
 'fuel_type': 'diesel',
 'id': 'd099f9e8-4db7-5950-ba77-1e6455188303',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL41759',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 112355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_ec93ee409146901ec49fbac547032c65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71769,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_9dc0c868055c4574a3c292675b8e9b0a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66948,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_3099694762a674492df61c33236dc621.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56931,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_a7f5ade1a27a62956812cbfba229541e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67598,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_d972f968f93087fe0df14051f6a7dfdd.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58827,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_8a2fe2f43df120ea90500a6ff1656e73.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57187,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_44bb6715e78c09e7c999d944e7b34939.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65040,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_105242248ebb6bf4052a495709dcdbfa.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_3f7c5fdb5d27cfd6e6686dd0d3e74101.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d099f9e8-4db7-5950-ba77-1e6455188303/d099f9e8-4db7-5950-ba77-1e6455188303_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58278,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img91/59/915910e1cc6609713e52afe7486ca138/pa/RL41759_edbecf00956010514b9ddacf033b776c.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2010}
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL41759%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.es] INFO: Saving data for RL41759: {'created_time': 1774868444.123335, 'last_price_update_time': 1774868444.123347, 'auction_closing_time': 1774969539.0}
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RL41759') HTTP/1.1" 204 0
2026-03-30 11:00:44 [auto1.es] INFO: Found listing with ID: VH94950
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH94950%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.es] INFO: Scrape type for VH94950: 0
2026-03-30 11:00:44 [auto1.es] INFO: Found listing with ID: MB90755
2026-03-30 11:00:44 [auto1.es] INFO: Found listing with ID: MW45147
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW45147%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.es] INFO: Scrape type for MW45147: 1
2026-03-30 11:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:44 [auto1.es] INFO: Found listing with ID: JP78473
2026-03-30 11:00:44 [auto1.es] INFO: Found listing with ID: XC72972
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC72972%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.es] INFO: Scrape type for XC72972: 1
2026-03-30 11:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:44 [auto1.es] INFO: Found listing with ID: PH62275
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH62275%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.es] INFO: Scrape type for PH62275: 2
2026-03-30 11:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 976fffb5-bb7b-51d4-ad08-d8757cedf4d2 with identifier: PH62275
2026-03-30 11:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 976fffb5-bb7b-51d4-ad08-d8757cedf4d2 with scrape type 2
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 976fffb5-bb7b-51d4-ad08-d8757cedf4d2 with scrape type 2
2026-03-30 11:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 976fffb5-bb7b-51d4-ad08-d8757cedf4d2, identifier: PH62275
2026-03-30 11:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 976fffb5-bb7b-51d4-ad08-d8757cedf4d2 with identifier: PH62275
2026-03-30 11:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 976fffb5-bb7b-51d4-ad08-d8757cedf4d2 with identifier: PH62275
2026-03-30 11:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 976fffb5-bb7b-51d4-ad08-d8757cedf4d2 with identifier: PH62275 to the API
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:17:51Z',
 'fuel_type': 'hybrid',
 'id': '976fffb5-bb7b-51d4-ad08-d8757cedf4d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH62275',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 67440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI e-HYBRID FR Go',
 'transmission': 'automatic',
 'trim': 'FR Go',
 'year': 2020}
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH62275%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.es] INFO: Saving data for PH62275: {'auction_closing_time': 1774970271.0, 'created_time': 1773238540.779589, 'last_price_update_time': 1774868444.705272}
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH62275') HTTP/1.1" 204 0
2026-03-30 11:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:44 [auto1.es] INFO: Found listing with ID: CM38953
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM38953%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.es] INFO: Scrape type for CM38953: 2
2026-03-30 11:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf37cef-5e24-5774-bd96-f2e7680b35af with identifier: CM38953
2026-03-30 11:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf37cef-5e24-5774-bd96-f2e7680b35af with scrape type 2
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcf37cef-5e24-5774-bd96-f2e7680b35af with scrape type 2
2026-03-30 11:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fcf37cef-5e24-5774-bd96-f2e7680b35af, identifier: CM38953
2026-03-30 11:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fcf37cef-5e24-5774-bd96-f2e7680b35af with identifier: CM38953
2026-03-30 11:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fcf37cef-5e24-5774-bd96-f2e7680b35af with identifier: CM38953
2026-03-30 11:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fcf37cef-5e24-5774-bd96-f2e7680b35af with identifier: CM38953 to the API
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:36:02Z',
 'fuel_type': 'diesel',
 'id': 'fcf37cef-5e24-5774-bd96-f2e7680b35af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM38953',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 77398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM38953%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [auto1.es] INFO: Saving data for CM38953: {'auction_closing_time': 1774971362.0, 'created_time': 1772140410.536734, 'last_price_update_time': 1774868445.21609}
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CM38953') HTTP/1.1" 204 0
2026-03-30 11:00:45 [auto1.es] INFO: Found listing with ID: JY50490
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY50490%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [auto1.es] INFO: Scrape type for JY50490: 2
2026-03-30 11:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e339209-48c9-5047-a551-3adc1b1352d7 with identifier: JY50490
2026-03-30 11:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e339209-48c9-5047-a551-3adc1b1352d7 with scrape type 2
2026-03-30 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e339209-48c9-5047-a551-3adc1b1352d7 with scrape type 2
2026-03-30 11:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e339209-48c9-5047-a551-3adc1b1352d7, identifier: JY50490
2026-03-30 11:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e339209-48c9-5047-a551-3adc1b1352d7 with identifier: JY50490
2026-03-30 11:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e339209-48c9-5047-a551-3adc1b1352d7 with identifier: JY50490
2026-03-30 11:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e339209-48c9-5047-a551-3adc1b1352d7 with identifier: JY50490 to the API
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:51:18Z',
 'fuel_type': 'diesel',
 'id': '4e339209-48c9-5047-a551-3adc1b1352d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY50490',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 269251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-03',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2007}
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY50490%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [auto1.es] INFO: Saving data for JY50490: {'auction_closing_time': 1774972278.0, 'created_time': 1772697638.937072, 'last_price_update_time': 1774868445.770346}
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JY50490') HTTP/1.1" 204 0
2026-03-30 11:00:45 [auto1.es] INFO: Found listing with ID: MA14893
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA14893%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [auto1.es] INFO: Scrape type for MA14893: 1
2026-03-30 11:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS29951> (referer: https://www.auto1.com/v1/car-details-view/JS29951/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:45 [auto1.es] INFO: Found listing with ID: UK20362
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK20362%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [auto1.es] INFO: Scrape type for UK20362: 1
2026-03-30 11:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:45 [auto1.es] INFO: Found listing with ID: VU27795
2026-03-30 11:00:45 [auto1.es] INFO: Found listing with ID: MZ74432
2026-03-30 11:00:45 [auto1.es] INFO: Found listing with ID: TX15158
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX15158%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [auto1.es] INFO: Scrape type for TX15158: 2
2026-03-30 11:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbaf19b4-c928-5c36-a89e-1f4623ab4f69 with identifier: TX15158
2026-03-30 11:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbaf19b4-c928-5c36-a89e-1f4623ab4f69 with scrape type 2
2026-03-30 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbaf19b4-c928-5c36-a89e-1f4623ab4f69 with scrape type 2
2026-03-30 11:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fbaf19b4-c928-5c36-a89e-1f4623ab4f69, identifier: TX15158
2026-03-30 11:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fbaf19b4-c928-5c36-a89e-1f4623ab4f69 with identifier: TX15158
2026-03-30 11:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fbaf19b4-c928-5c36-a89e-1f4623ab4f69 with identifier: TX15158
2026-03-30 11:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fbaf19b4-c928-5c36-a89e-1f4623ab4f69 with identifier: TX15158 to the API
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:50:27Z',
 'fuel_type': 'diesel',
 'id': 'fbaf19b4-c928-5c36-a89e-1f4623ab4f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX15158',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 118518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 116 CDI Pro lang',
 'transmission': 'automatic',
 'trim': 'Pro lang',
 'year': 2021}
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX15158%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.es] INFO: Saving data for TX15158: {'auction_closing_time': 1774972227.0, 'created_time': 1773691464.322062, 'last_price_update_time': 1774868446.287459}
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TX15158') HTTP/1.1" 204 0
2026-03-30 11:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:46 [auto1.es] INFO: Found listing with ID: BP04557
2026-03-30 11:00:46 [auto1.es] INFO: Found listing with ID: ZT79266
2026-03-30 11:00:46 [auto1.es] INFO: Found listing with ID: NA01743
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA01743%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.es] INFO: Scrape type for NA01743: 1
2026-03-30 11:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb91e4a6-05db-56e3-afc5-587cdbe3533e with identifier: JS29951
2026-03-30 11:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb91e4a6-05db-56e3-afc5-587cdbe3533e with scrape type 1
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_db30fbe298857412fc7c868d0bfaede5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_db30fbe298857412fc7c868d0bfaede5.jpg not downloaded yet
2026-03-30 11:00:46 [auto1.es] INFO: Found listing with ID: ZD80422
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD80422%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.es] INFO: Scrape type for ZD80422: 1
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_a1dfd71450f02e61eeac68471895a58c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_a1dfd71450f02e61eeac68471895a58c.jpg not downloaded yet
2026-03-30 11:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:46 [auto1.es] INFO: Found listing with ID: CN25328
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN25328%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.es] INFO: Scrape type for CN25328: 1
2026-03-30 11:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_8a80071584b7505798d62da029b45b76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_8a80071584b7505798d62da029b45b76.jpg not downloaded yet
2026-03-30 11:00:46 [auto1.es] INFO: Found listing with ID: FC08911
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC08911%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.es] INFO: Scrape type for FC08911: 2
2026-03-30 11:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with identifier: FC08911
2026-03-30 11:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with scrape type 2
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with scrape type 2
2026-03-30 11:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9ddb53f2-c47a-56ba-a733-5e38740c3c38, identifier: FC08911
2026-03-30 11:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with identifier: FC08911
2026-03-30 11:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with identifier: FC08911
2026-03-30 11:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with identifier: FC08911 to the API
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:50:22Z',
 'fuel_type': 'diesel',
 'id': '9ddb53f2-c47a-56ba-a733-5e38740c3c38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC08911',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 47337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC08911%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.es] INFO: Saving data for FC08911: {'auction_closing_time': 1774972222.0, 'created_time': 1773907233.149562, 'last_price_update_time': 1774868447.048191}
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FC08911') HTTP/1.1" 204 0
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_c037390171f3b2af4e29bf33a35d2603.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_c037390171f3b2af4e29bf33a35d2603.jpg not downloaded yet
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: UY14262
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY14262%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.es] INFO: Scrape type for UY14262: 1
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_279b6f915e1f36bb89bdbc3969870ccb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_279b6f915e1f36bb89bdbc3969870ccb.jpg not downloaded yet
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: AC42816
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: LA52472
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA52472%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.es] INFO: Scrape type for LA52472: 2
2026-03-30 11:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eb9c84f-85e7-5df1-bfbf-ec99f9797631 with identifier: LA52472
2026-03-30 11:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eb9c84f-85e7-5df1-bfbf-ec99f9797631 with scrape type 2
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1eb9c84f-85e7-5df1-bfbf-ec99f9797631 with scrape type 2
2026-03-30 11:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1eb9c84f-85e7-5df1-bfbf-ec99f9797631, identifier: LA52472
2026-03-30 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_db30fbe298857412fc7c868d0bfaede5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1eb9c84f-85e7-5df1-bfbf-ec99f9797631 with identifier: LA52472
2026-03-30 11:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1eb9c84f-85e7-5df1-bfbf-ec99f9797631 with identifier: LA52472
2026-03-30 11:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1eb9c84f-85e7-5df1-bfbf-ec99f9797631 with identifier: LA52472 to the API
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:16:36Z',
 'fuel_type': 'diesel',
 'id': '1eb9c84f-85e7-5df1-bfbf-ec99f9797631',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA52472',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 227856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-26',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA52472%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.es] INFO: Saving data for LA52472: {'auction_closing_time': 1774970196.0, 'created_time': 1774263812.670423, 'last_price_update_time': 1774868447.567437}
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LA52472') HTTP/1.1" 204 0
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_dd056de38f714c6ee0cdacda69730beb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_dd056de38f714c6ee0cdacda69730beb.jpg not downloaded yet
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: JN94907
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: YP32131
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: UR30668
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: KV96950
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: VH67145
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH67145%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.es] INFO: Scrape type for VH67145: 1
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_5d1ddd9070a470ad168659858a6499d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_5d1ddd9070a470ad168659858a6499d7.jpg not downloaded yet
2026-03-30 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_a1dfd71450f02e61eeac68471895a58c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: VY38329
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY38329%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.es] INFO: Scrape type for VY38329: 1
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd2dff50>
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_db30fbe298857412fc7c868d0bfaede5.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_db30fbe298857412fc7c868d0bfaede5.jpg saved to cache
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_8a80071584b7505798d62da029b45b76.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_41ed7836033bd732cc80601327fc99ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_41ed7836033bd732cc80601327fc99ff.jpg not downloaded yet
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: NF65765
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: GR53173
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR53173%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.es] INFO: Scrape type for GR53173: 1
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_930c0569309a43b92a61156643443774.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_930c0569309a43b92a61156643443774.jpg not downloaded yet
2026-03-30 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_c037390171f3b2af4e29bf33a35d2603.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: JU92139
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: ZW32185
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW32185%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.es] INFO: Scrape type for ZW32185: 1
2026-03-30 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_279b6f915e1f36bb89bdbc3969870ccb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_f76862e802a563bde65c87d5aa439142.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_f76862e802a563bde65c87d5aa439142.jpg not downloaded yet
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb64194d0>
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_a1dfd71450f02e61eeac68471895a58c.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_a1dfd71450f02e61eeac68471895a58c.jpg saved to cache
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:47 [auto1.es] INFO: Found listing with ID: JZ24217
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ24217%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.es] INFO: Scrape type for JZ24217: 2
2026-03-30 11:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cd3996f-e0f5-5e6c-be55-41a454097e39 with identifier: JZ24217
2026-03-30 11:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cd3996f-e0f5-5e6c-be55-41a454097e39 with scrape type 2
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cd3996f-e0f5-5e6c-be55-41a454097e39 with scrape type 2
2026-03-30 11:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3cd3996f-e0f5-5e6c-be55-41a454097e39, identifier: JZ24217
2026-03-30 11:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3cd3996f-e0f5-5e6c-be55-41a454097e39 with identifier: JZ24217
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 11:00:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3cd3996f-e0f5-5e6c-be55-41a454097e39 with identifier: JZ24217
2026-03-30 11:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3cd3996f-e0f5-5e6c-be55-41a454097e39 with identifier: JZ24217 to the API
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:28:28Z',
 'fuel_type': 'diesel',
 'id': '3cd3996f-e0f5-5e6c-be55-41a454097e39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ24217',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 249549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-19',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2017}
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ24217%27 HTTP/1.1" 200 None
2026-03-30 11:00:48 [auto1.es] INFO: Saving data for JZ24217: {'auction_closing_time': 1774970908.0, 'created_time': 1774296353.589917, 'last_price_update_time': 1774868448.49814}
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JZ24217') HTTP/1.1" 204 0
2026-03-30 11:00:48 [auto1.es] INFO: Found listing with ID: RZ14437
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ14437%27 HTTP/1.1" 200 None
2026-03-30 11:00:48 [auto1.es] INFO: Scrape type for RZ14437: 2
2026-03-30 11:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68cfb443-d734-55a6-8e6f-0c771a8fb63e with identifier: RZ14437
2026-03-30 11:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68cfb443-d734-55a6-8e6f-0c771a8fb63e with scrape type 2
2026-03-30 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68cfb443-d734-55a6-8e6f-0c771a8fb63e with scrape type 2
2026-03-30 11:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68cfb443-d734-55a6-8e6f-0c771a8fb63e, identifier: RZ14437
2026-03-30 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6470710>
2026-03-30 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_8a80071584b7505798d62da029b45b76.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_8a80071584b7505798d62da029b45b76.jpg saved to cache
2026-03-30 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_dd056de38f714c6ee0cdacda69730beb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_930c0569309a43b92a61156643443774.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68cfb443-d734-55a6-8e6f-0c771a8fb63e with identifier: RZ14437
2026-03-30 11:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68cfb443-d734-55a6-8e6f-0c771a8fb63e with identifier: RZ14437
2026-03-30 11:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 68cfb443-d734-55a6-8e6f-0c771a8fb63e with identifier: RZ14437 to the API
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:21:51Z',
 'fuel_type': 'petrol',
 'id': '68cfb443-d734-55a6-8e6f-0c771a8fb63e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ14437',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 99807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-31',
 'seller_name': None,
 'title': 'Citroen C3 1.4 SX Plus',
 'transmission': 'manual',
 'trim': 'SX Plus',
 'year': 2006}
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ14437%27 HTTP/1.1" 200 None
2026-03-30 11:00:49 [auto1.es] INFO: Saving data for RZ14437: {'auction_closing_time': 1774970511.0, 'created_time': 1774090880.674121, 'last_price_update_time': 1774868449.131721}
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RZ14437') HTTP/1.1" 204 0
2026-03-30 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_5d1ddd9070a470ad168659858a6499d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: EG30412
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG30412%27 HTTP/1.1" 200 None
2026-03-30 11:00:49 [auto1.es] INFO: Scrape type for EG30412: 1
2026-03-30 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA01743/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb650fe10>
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_c037390171f3b2af4e29bf33a35d2603.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_c037390171f3b2af4e29bf33a35d2603.jpg saved to cache
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66e8a10>
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_279b6f915e1f36bb89bdbc3969870ccb.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_279b6f915e1f36bb89bdbc3969870ccb.jpg saved to cache
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: VR33132
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: PH66754
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: NF19160
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: AM93012
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: JN23347
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN23347%27 HTTP/1.1" 200 None
2026-03-30 11:00:49 [auto1.es] INFO: Scrape type for JN23347: 1
2026-03-30 11:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbcfefd50>
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_dd056de38f714c6ee0cdacda69730beb.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_dd056de38f714c6ee0cdacda69730beb.jpg saved to cache
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66ac490>
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_930c0569309a43b92a61156643443774.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_930c0569309a43b92a61156643443774.jpg saved to cache
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc2269d0>
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_5d1ddd9070a470ad168659858a6499d7.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_5d1ddd9070a470ad168659858a6499d7.jpg saved to cache
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:49 [auto1.es] INFO: Channel: 24h | Page: 3 | totalHits: 2193 | hits on page: 40
2026-03-30 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_f76862e802a563bde65c87d5aa439142.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_41ed7836033bd732cc80601327fc99ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: JN23347
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: JZ66468
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ66468%27 HTTP/1.1" 200 None
2026-03-30 11:00:49 [auto1.es] INFO: Scrape type for JZ66468: 2
2026-03-30 11:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 347a0add-cf8c-5077-a567-4b609f861eab with identifier: JZ66468
2026-03-30 11:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 347a0add-cf8c-5077-a567-4b609f861eab with scrape type 2
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 347a0add-cf8c-5077-a567-4b609f861eab with scrape type 2
2026-03-30 11:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 347a0add-cf8c-5077-a567-4b609f861eab, identifier: JZ66468
2026-03-30 11:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 347a0add-cf8c-5077-a567-4b609f861eab with identifier: JZ66468
2026-03-30 11:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 347a0add-cf8c-5077-a567-4b609f861eab with identifier: JZ66468
2026-03-30 11:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 347a0add-cf8c-5077-a567-4b609f861eab with identifier: JZ66468 to the API
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:34:53Z',
 'fuel_type': 'diesel',
 'id': '347a0add-cf8c-5077-a567-4b609f861eab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ66468',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 162178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Line',
 'year': 2015}
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ66468%27 HTTP/1.1" 200 None
2026-03-30 11:00:49 [auto1.es] INFO: Saving data for JZ66468: {'auction_closing_time': 1774971293.0, 'created_time': 1773181679.551202, 'last_price_update_time': 1774868449.917266}
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JZ66468') HTTP/1.1" 204 0
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: BN28456
2026-03-30 11:00:49 [auto1.es] INFO: Found listing with ID: WU48327
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU48327%27 HTTP/1.1" 200 None
2026-03-30 11:00:49 [auto1.es] INFO: Scrape type for WU48327: 1
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb661b6d0>
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_f76862e802a563bde65c87d5aa439142.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_f76862e802a563bde65c87d5aa439142.jpg saved to cache
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd7fd410>
2026-03-30 11:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fc6%252F02c604b1ec39e277bf8a352aa22ba9fe%252Fpa%252FJS29951_41ed7836033bd732cc80601327fc99ff.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_41ed7836033bd732cc80601327fc99ff.jpg saved to cache
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb91e4a6-05db-56e3-afc5-587cdbe3533e
2026-03-30 11:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb91e4a6-05db-56e3-afc5-587cdbe3533e, skipping ID generation
2026-03-30 11:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb91e4a6-05db-56e3-afc5-587cdbe3533e with scrape type 1
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb91e4a6-05db-56e3-afc5-587cdbe3533e sending to next pipeline
2026-03-30 11:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb91e4a6-05db-56e3-afc5-587cdbe3533e, identifier: JS29951
2026-03-30 11:00:50 [auto1.es] INFO: Found listing with ID: FG26244
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG26244%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [auto1.es] INFO: Scrape type for FG26244: 1
2026-03-30 11:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb91e4a6-05db-56e3-afc5-587cdbe3533e with identifier: JS29951
2026-03-30 11:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb91e4a6-05db-56e3-afc5-587cdbe3533e with identifier: JS29951
2026-03-30 11:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eb91e4a6-05db-56e3-afc5-587cdbe3533e with identifier: JS29951 to the API
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_41ed7836033bd732cc80601327fc99ff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:37:02Z',
 'fuel_type': 'petrol',
 'id': 'eb91e4a6-05db-56e3-afc5-587cdbe3533e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS29951',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 13613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240558,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_db30fbe298857412fc7c868d0bfaede5.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240558,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_a1dfd71450f02e61eeac68471895a58c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240558,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_8a80071584b7505798d62da029b45b76.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240558,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_c037390171f3b2af4e29bf33a35d2603.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240558,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_279b6f915e1f36bb89bdbc3969870ccb.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240558,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_dd056de38f714c6ee0cdacda69730beb.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240558,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_5d1ddd9070a470ad168659858a6499d7.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240558,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_41ed7836033bd732cc80601327fc99ff.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45418,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_930c0569309a43b92a61156643443774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb91e4a6-05db-56e3-afc5-587cdbe3533e/eb91e4a6-05db-56e3-afc5-587cdbe3533e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142518,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img02/c6/02c604b1ec39e277bf8a352aa22ba9fe/pa/JS29951_f76862e802a563bde65c87d5aa439142.jpg',
             'Width': 1920}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 30 TFSI Adrenalin',
 'transmission': 'automatic',
 'trim': 'Adrenalin',
 'year': 2025}
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS29951%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [auto1.es] INFO: Saving data for JS29951: {'created_time': 1774868450.588328, 'last_price_update_time': 1774868450.588339, 'auction_closing_time': 1774971422.0}
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JS29951') HTTP/1.1" 204 0
2026-03-30 11:00:50 [auto1.es] INFO: Found listing with ID: VC05835
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC05835%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [auto1.es] INFO: Scrape type for VC05835: 2
2026-03-30 11:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebe9e028-c3d5-5d52-b5cb-0b571a01a36e with identifier: VC05835
2026-03-30 11:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebe9e028-c3d5-5d52-b5cb-0b571a01a36e with scrape type 2
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebe9e028-c3d5-5d52-b5cb-0b571a01a36e with scrape type 2
2026-03-30 11:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ebe9e028-c3d5-5d52-b5cb-0b571a01a36e, identifier: VC05835
2026-03-30 11:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ebe9e028-c3d5-5d52-b5cb-0b571a01a36e with identifier: VC05835
2026-03-30 11:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ebe9e028-c3d5-5d52-b5cb-0b571a01a36e with identifier: VC05835
2026-03-30 11:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ebe9e028-c3d5-5d52-b5cb-0b571a01a36e with identifier: VC05835 to the API
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:06:30Z',
 'fuel_type': 'petrol',
 'id': 'ebe9e028-c3d5-5d52-b5cb-0b571a01a36e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC05835',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 111499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2018}
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC05835%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.es] INFO: Saving data for VC05835: {'auction_closing_time': 1774969590.0, 'created_time': 1773126750.512216, 'last_price_update_time': 1774868451.158478}
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC05835') HTTP/1.1" 204 0
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: YF63614
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF63614%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.es] INFO: Scrape type for YF63614: 1
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: GC12558
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: JF50007
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: HJ95484
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: VR74696
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: ZU15820
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: JN80482
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN80482%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.es] INFO: Scrape type for JN80482: 2
2026-03-30 11:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bbcfa6f-11a5-5f2a-92fb-3ac48b62c1c0 with identifier: JN80482
2026-03-30 11:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bbcfa6f-11a5-5f2a-92fb-3ac48b62c1c0 with scrape type 2
2026-03-30 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bbcfa6f-11a5-5f2a-92fb-3ac48b62c1c0 with scrape type 2
2026-03-30 11:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3bbcfa6f-11a5-5f2a-92fb-3ac48b62c1c0, identifier: JN80482
2026-03-30 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW45147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3bbcfa6f-11a5-5f2a-92fb-3ac48b62c1c0 with identifier: JN80482
2026-03-30 11:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3bbcfa6f-11a5-5f2a-92fb-3ac48b62c1c0 with identifier: JN80482
2026-03-30 11:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3bbcfa6f-11a5-5f2a-92fb-3ac48b62c1c0 with identifier: JN80482 to the API
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-31T15:38:44Z',
 'fuel_type': 'petrol',
 'id': '3bbcfa6f-11a5-5f2a-92fb-3ac48b62c1c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN80482',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 133446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 5.0 V8 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2018}
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN80482%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.es] INFO: Saving data for JN80482: {'auction_closing_time': 1774971524.0, 'created_time': 1774382687.824929, 'last_price_update_time': 1774868451.610132}
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JN80482') HTTP/1.1" 204 0
2026-03-30 11:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: KE39848
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: ZF17550
2026-03-30 11:00:51 [auto1.es] INFO: Found listing with ID: FN30855
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN30855%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.es] INFO: Scrape type for FN30855: 2
2026-03-30 11:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35f39e01-633f-5882-b2d3-5349c80379e3 with identifier: FN30855
2026-03-30 11:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35f39e01-633f-5882-b2d3-5349c80379e3 with scrape type 2
2026-03-30 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35f39e01-633f-5882-b2d3-5349c80379e3 with scrape type 2
2026-03-30 11:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35f39e01-633f-5882-b2d3-5349c80379e3, identifier: FN30855
2026-03-30 11:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35f39e01-633f-5882-b2d3-5349c80379e3 with identifier: FN30855
2026-03-30 11:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35f39e01-633f-5882-b2d3-5349c80379e3 with identifier: FN30855
2026-03-30 11:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 35f39e01-633f-5882-b2d3-5349c80379e3 with identifier: FN30855 to the API
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:46:45Z',
 'fuel_type': 'diesel',
 'id': '35f39e01-633f-5882-b2d3-5349c80379e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN30855',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 133899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'Land Rover Range Rover 4.4 SDI Autobiography',
 'transmission': 'automatic',
 'trim': 'Autobiography',
 'year': 2014}
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN30855%27 HTTP/1.1" 200 None
2026-03-30 11:00:52 [auto1.es] INFO: Saving data for FN30855: {'auction_closing_time': 1774972005.0, 'created_time': 1774382688.410562, 'last_price_update_time': 1774868452.127925}
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN30855') HTTP/1.1" 204 0
2026-03-30 11:00:52 [auto1.es] INFO: Found listing with ID: XA30952
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA30952%27 HTTP/1.1" 200 None
2026-03-30 11:00:52 [auto1.es] INFO: Scrape type for XA30952: 2
2026-03-30 11:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88d958c6-b31a-5efa-8593-ab0da0ca0872 with identifier: XA30952
2026-03-30 11:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d958c6-b31a-5efa-8593-ab0da0ca0872 with scrape type 2
2026-03-30 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88d958c6-b31a-5efa-8593-ab0da0ca0872 with scrape type 2
2026-03-30 11:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88d958c6-b31a-5efa-8593-ab0da0ca0872, identifier: XA30952
2026-03-30 11:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88d958c6-b31a-5efa-8593-ab0da0ca0872 with identifier: XA30952
2026-03-30 11:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88d958c6-b31a-5efa-8593-ab0da0ca0872 with identifier: XA30952
2026-03-30 11:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88d958c6-b31a-5efa-8593-ab0da0ca0872 with identifier: XA30952 to the API
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 343,
 'expiration_date': '2026-03-31T15:58:42Z',
 'fuel_type': 'petrol',
 'id': '88d958c6-b31a-5efa-8593-ab0da0ca0872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA30952',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 66171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-22',
 'seller_name': None,
 'title': 'BMW 3er M3',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA30952%27 HTTP/1.1" 200 None
2026-03-30 11:00:52 [auto1.es] INFO: Saving data for XA30952: {'auction_closing_time': 1774972722.0, 'created_time': 1774382778.858164, 'last_price_update_time': 1774868452.675914}
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XA30952') HTTP/1.1" 204 0
2026-03-30 11:00:52 [auto1.es] INFO: Found listing with ID: CY31479
2026-03-30 11:00:52 [auto1.es] INFO: Found listing with ID: ZM68351
2026-03-30 11:00:52 [auto1.es] INFO: Found listing with ID: FH27641
2026-03-30 11:00:52 [auto1.es] INFO: Found listing with ID: VF55417
2026-03-30 11:00:52 [auto1.es] INFO: Found listing with ID: ML73302
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML73302%27 HTTP/1.1" 200 None
2026-03-30 11:00:52 [auto1.es] INFO: Scrape type for ML73302: 1
2026-03-30 11:00:52 [auto1.es] INFO: Found listing with ID: DE85844
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE85844%27 HTTP/1.1" 200 None
2026-03-30 11:00:52 [auto1.es] INFO: Scrape type for DE85844: 2
2026-03-30 11:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4f5d695-943b-552d-add8-649a7944fe55 with identifier: DE85844
2026-03-30 11:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f5d695-943b-552d-add8-649a7944fe55 with scrape type 2
2026-03-30 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4f5d695-943b-552d-add8-649a7944fe55 with scrape type 2
2026-03-30 11:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f4f5d695-943b-552d-add8-649a7944fe55, identifier: DE85844
2026-03-30 11:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f4f5d695-943b-552d-add8-649a7944fe55 with identifier: DE85844
2026-03-30 11:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f4f5d695-943b-552d-add8-649a7944fe55 with identifier: DE85844
2026-03-30 11:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f4f5d695-943b-552d-add8-649a7944fe55 with identifier: DE85844 to the API
2026-03-30 11:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:49:11Z',
 'fuel_type': 'diesel',
 'id': 'f4f5d695-943b-552d-add8-649a7944fe55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE85844',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 6,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-30',
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE85844%27 HTTP/1.1" 200 None
2026-03-30 11:00:53 [auto1.es] INFO: Saving data for DE85844: {'auction_closing_time': 1774972151.0, 'created_time': 1774641767.940461, 'last_price_update_time': 1774868453.195276}
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DE85844') HTTP/1.1" 204 0
2026-03-30 11:00:53 [auto1.es] INFO: Found listing with ID: CN83416
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN83416%27 HTTP/1.1" 200 None
2026-03-30 11:00:53 [auto1.es] INFO: Scrape type for CN83416: 2
2026-03-30 11:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a3395ca-95d4-5614-9245-a95314e05358 with identifier: CN83416
2026-03-30 11:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a3395ca-95d4-5614-9245-a95314e05358 with scrape type 2
2026-03-30 11:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a3395ca-95d4-5614-9245-a95314e05358 with scrape type 2
2026-03-30 11:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6a3395ca-95d4-5614-9245-a95314e05358, identifier: CN83416
2026-03-30 11:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6a3395ca-95d4-5614-9245-a95314e05358 with identifier: CN83416
2026-03-30 11:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6a3395ca-95d4-5614-9245-a95314e05358 with identifier: CN83416
2026-03-30 11:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6a3395ca-95d4-5614-9245-a95314e05358 with identifier: CN83416 to the API
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 449,
 'expiration_date': '2026-03-31T15:48:56Z',
 'fuel_type': 'petrol',
 'id': '6a3395ca-95d4-5614-9245-a95314e05358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN83416',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 41482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-26',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT Convertible',
 'transmission': 'automatic',
 'trim': 'GT Convertible',
 'year': 2023}
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN83416%27 HTTP/1.1" 200 None
2026-03-30 11:00:53 [auto1.es] INFO: Saving data for CN83416: {'auction_closing_time': 1774972136.0, 'created_time': 1774641769.050154, 'last_price_update_time': 1774868453.778886}
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CN83416') HTTP/1.1" 204 0
2026-03-30 11:00:53 [auto1.es] INFO: Found listing with ID: RA16154
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA16154%27 HTTP/1.1" 200 None
2026-03-30 11:00:53 [auto1.es] INFO: Scrape type for RA16154: 2
2026-03-30 11:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60f694ff-c0c4-5504-b959-eb576646fcbc with identifier: RA16154
2026-03-30 11:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60f694ff-c0c4-5504-b959-eb576646fcbc with scrape type 2
2026-03-30 11:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60f694ff-c0c4-5504-b959-eb576646fcbc with scrape type 2
2026-03-30 11:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60f694ff-c0c4-5504-b959-eb576646fcbc, identifier: RA16154
2026-03-30 11:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60f694ff-c0c4-5504-b959-eb576646fcbc with identifier: RA16154
2026-03-30 11:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60f694ff-c0c4-5504-b959-eb576646fcbc with identifier: RA16154
2026-03-30 11:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60f694ff-c0c4-5504-b959-eb576646fcbc with identifier: RA16154 to the API
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:23:52Z',
 'fuel_type': 'diesel',
 'id': '60f694ff-c0c4-5504-b959-eb576646fcbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA16154',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 60755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA16154%27 HTTP/1.1" 200 None
2026-03-30 11:00:54 [auto1.es] INFO: Saving data for RA16154: {'auction_closing_time': 1774970632.0, 'created_time': 1774641772.128807, 'last_price_update_time': 1774868454.23175}
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RA16154') HTTP/1.1" 204 0
2026-03-30 11:00:54 [auto1.es] INFO: Found listing with ID: FT58474
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT58474%27 HTTP/1.1" 200 None
2026-03-30 11:00:54 [auto1.es] INFO: Scrape type for FT58474: 1
2026-03-30 11:00:54 [auto1.es] INFO: Found listing with ID: CP61201
2026-03-30 11:00:54 [auto1.es] INFO: Found listing with ID: AV19978
2026-03-30 11:00:54 [auto1.es] INFO: Found listing with ID: PD13056
2026-03-30 11:00:54 [auto1.es] INFO: Found listing with ID: GZ41866
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ41866%27 HTTP/1.1" 200 None
2026-03-30 11:00:54 [auto1.es] INFO: Scrape type for GZ41866: 2
2026-03-30 11:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b2276c1-b4ed-508c-849a-a3cac3592ef6 with identifier: GZ41866
2026-03-30 11:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2276c1-b4ed-508c-849a-a3cac3592ef6 with scrape type 2
2026-03-30 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b2276c1-b4ed-508c-849a-a3cac3592ef6 with scrape type 2
2026-03-30 11:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b2276c1-b4ed-508c-849a-a3cac3592ef6, identifier: GZ41866
2026-03-30 11:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b2276c1-b4ed-508c-849a-a3cac3592ef6 with identifier: GZ41866
2026-03-30 11:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b2276c1-b4ed-508c-849a-a3cac3592ef6 with identifier: GZ41866
2026-03-30 11:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b2276c1-b4ed-508c-849a-a3cac3592ef6 with identifier: GZ41866 to the API
2026-03-30 11:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:20:49Z',
 'fuel_type': 'diesel',
 'id': '4b2276c1-b4ed-508c-849a-a3cac3592ef6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ41866',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 129165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2012}
2026-03-30 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ41866%27 HTTP/1.1" 200 None
2026-03-30 11:00:55 [auto1.es] INFO: Saving data for GZ41866: {'auction_closing_time': 1774970449.0, 'created_time': 1773248809.533764, 'last_price_update_time': 1774868455.703052}
2026-03-30 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GZ41866') HTTP/1.1" 204 0
2026-03-30 11:00:55 [auto1.es] INFO: Found listing with ID: RA30082
2026-03-30 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA30082%27 HTTP/1.1" 200 None
2026-03-30 11:00:55 [auto1.es] INFO: Scrape type for RA30082: 2
2026-03-30 11:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c8248b7-f17a-5250-83f7-c43b9023be3f with identifier: RA30082
2026-03-30 11:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8248b7-f17a-5250-83f7-c43b9023be3f with scrape type 2
2026-03-30 11:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c8248b7-f17a-5250-83f7-c43b9023be3f with scrape type 2
2026-03-30 11:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c8248b7-f17a-5250-83f7-c43b9023be3f, identifier: RA30082
2026-03-30 11:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c8248b7-f17a-5250-83f7-c43b9023be3f with identifier: RA30082
2026-03-30 11:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c8248b7-f17a-5250-83f7-c43b9023be3f with identifier: RA30082
2026-03-30 11:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c8248b7-f17a-5250-83f7-c43b9023be3f with identifier: RA30082 to the API
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:59:48Z',
 'fuel_type': 'diesel',
 'id': '4c8248b7-f17a-5250-83f7-c43b9023be3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA30082',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 186787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-08',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA30082%27 HTTP/1.1" 200 None
2026-03-30 11:00:56 [auto1.es] INFO: Saving data for RA30082: {'auction_closing_time': 1774972788.0, 'created_time': 1773130096.554465, 'last_price_update_time': 1774868456.261375}
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RA30082') HTTP/1.1" 204 0
2026-03-30 11:00:56 [auto1.es] INFO: Found listing with ID: ZL14108
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL14108%27 HTTP/1.1" 200 None
2026-03-30 11:00:56 [auto1.es] INFO: Scrape type for ZL14108: 2
2026-03-30 11:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a306c913-1ae3-5882-83da-5b0bb60e0e8f with identifier: ZL14108
2026-03-30 11:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a306c913-1ae3-5882-83da-5b0bb60e0e8f with scrape type 2
2026-03-30 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a306c913-1ae3-5882-83da-5b0bb60e0e8f with scrape type 2
2026-03-30 11:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a306c913-1ae3-5882-83da-5b0bb60e0e8f, identifier: ZL14108
2026-03-30 11:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a306c913-1ae3-5882-83da-5b0bb60e0e8f with identifier: ZL14108
2026-03-30 11:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a306c913-1ae3-5882-83da-5b0bb60e0e8f with identifier: ZL14108
2026-03-30 11:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a306c913-1ae3-5882-83da-5b0bb60e0e8f with identifier: ZL14108 to the API
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:11:03Z',
 'fuel_type': 'diesel',
 'id': 'a306c913-1ae3-5882-83da-5b0bb60e0e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL14108',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 275196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-02',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2017}
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL14108%27 HTTP/1.1" 200 None
2026-03-30 11:00:56 [auto1.es] INFO: Saving data for ZL14108: {'auction_closing_time': 1774969863.0, 'created_time': 1773248808.105874, 'last_price_update_time': 1774868456.719195}
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL14108') HTTP/1.1" 204 0
2026-03-30 11:00:56 [auto1.es] INFO: Found listing with ID: EN27378
2026-03-30 11:00:56 [auto1.es] INFO: Found listing with ID: JG71892
2026-03-30 11:00:56 [auto1.es] INFO: Found listing with ID: WY74843
2026-03-30 11:00:56 [auto1.es] INFO: Found listing with ID: JE22210
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE22210%27 HTTP/1.1" 200 None
2026-03-30 11:00:56 [auto1.es] INFO: Scrape type for JE22210: 2
2026-03-30 11:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414f79f0-30ba-524e-b0f3-d3cfead89651 with identifier: JE22210
2026-03-30 11:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414f79f0-30ba-524e-b0f3-d3cfead89651 with scrape type 2
2026-03-30 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 414f79f0-30ba-524e-b0f3-d3cfead89651 with scrape type 2
2026-03-30 11:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 414f79f0-30ba-524e-b0f3-d3cfead89651, identifier: JE22210
2026-03-30 11:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 414f79f0-30ba-524e-b0f3-d3cfead89651 with identifier: JE22210
2026-03-30 11:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 414f79f0-30ba-524e-b0f3-d3cfead89651 with identifier: JE22210
2026-03-30 11:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 414f79f0-30ba-524e-b0f3-d3cfead89651 with identifier: JE22210 to the API
2026-03-30 11:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:28:17Z',
 'fuel_type': 'petrol',
 'id': '414f79f0-30ba-524e-b0f3-d3cfead89651',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE22210',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 144604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE22210%27 HTTP/1.1" 200 None
2026-03-30 11:00:57 [auto1.es] INFO: Saving data for JE22210: {'auction_closing_time': 1774970897.0, 'created_time': 1774382502.123814, 'last_price_update_time': 1774868457.191197}
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JE22210') HTTP/1.1" 204 0
2026-03-30 11:00:57 [auto1.es] INFO: Found listing with ID: PF71575
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF71575%27 HTTP/1.1" 200 None
2026-03-30 11:00:57 [auto1.es] INFO: Scrape type for PF71575: 1
2026-03-30 11:00:57 [auto1.es] INFO: Found listing with ID: AL71492
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL71492%27 HTTP/1.1" 200 None
2026-03-30 11:00:57 [auto1.es] INFO: Scrape type for AL71492: 2
2026-03-30 11:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af4de5dc-5452-525c-9523-5cfb702d6557 with identifier: AL71492
2026-03-30 11:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af4de5dc-5452-525c-9523-5cfb702d6557 with scrape type 2
2026-03-30 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af4de5dc-5452-525c-9523-5cfb702d6557 with scrape type 2
2026-03-30 11:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af4de5dc-5452-525c-9523-5cfb702d6557, identifier: AL71492
2026-03-30 11:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af4de5dc-5452-525c-9523-5cfb702d6557 with identifier: AL71492
2026-03-30 11:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af4de5dc-5452-525c-9523-5cfb702d6557 with identifier: AL71492
2026-03-30 11:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af4de5dc-5452-525c-9523-5cfb702d6557 with identifier: AL71492 to the API
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:39:46Z',
 'fuel_type': 'petrol',
 'id': 'af4de5dc-5452-525c-9523-5cfb702d6557',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL71492',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 252754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-15',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2003}
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL71492%27 HTTP/1.1" 200 None
2026-03-30 11:00:57 [auto1.es] INFO: Saving data for AL71492: {'auction_closing_time': 1774971586.0, 'created_time': 1774263645.127027, 'last_price_update_time': 1774868457.753465}
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AL71492') HTTP/1.1" 204 0
2026-03-30 11:00:57 [auto1.es] INFO: Found listing with ID: JM59673
2026-03-30 11:00:57 [auto1.es] INFO: Found listing with ID: FK36826
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK36826%27 HTTP/1.1" 200 None
2026-03-30 11:00:57 [auto1.es] INFO: Scrape type for FK36826: 2
2026-03-30 11:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50716954-e7ae-5b63-bdec-c92b342a69b6 with identifier: FK36826
2026-03-30 11:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50716954-e7ae-5b63-bdec-c92b342a69b6 with scrape type 2
2026-03-30 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50716954-e7ae-5b63-bdec-c92b342a69b6 with scrape type 2
2026-03-30 11:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50716954-e7ae-5b63-bdec-c92b342a69b6, identifier: FK36826
2026-03-30 11:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50716954-e7ae-5b63-bdec-c92b342a69b6 with identifier: FK36826
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 11:00:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50716954-e7ae-5b63-bdec-c92b342a69b6 with identifier: FK36826
2026-03-30 11:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50716954-e7ae-5b63-bdec-c92b342a69b6 with identifier: FK36826 to the API
2026-03-30 11:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:12:31Z',
 'fuel_type': 'electro',
 'id': '50716954-e7ae-5b63-bdec-c92b342a69b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK36826',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Leaf',
 'odometer': 147106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-27',
 'seller_name': None,
 'title': 'Nissan Leaf electric drive 80 kW Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2016}
2026-03-30 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK36826%27 HTTP/1.1" 200 None
2026-03-30 11:00:58 [auto1.es] INFO: Saving data for FK36826: {'auction_closing_time': 1774969951.0, 'created_time': 1774641898.99434, 'last_price_update_time': 1774868458.425299}
2026-03-30 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK36826') HTTP/1.1" 204 0
2026-03-30 11:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA14893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG08794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:04 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 29 pages/min), scraped 40 items (at 40 items/min)
2026-03-30 11:01:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY38329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR53173/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC72972/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW32185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:52 [auto1.es] INFO: Channel: 24h | Page: 4 | totalHits: 2192 | hits on page: 40
2026-03-30 11:01:52 [auto1.es] INFO: Found listing with ID: CS58212
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS58212%27 HTTP/1.1" 200 None
2026-03-30 11:01:52 [auto1.es] INFO: Scrape type for CS58212: 2
2026-03-30 11:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aad93f9-f648-50e8-8b61-6c91d875900d with identifier: CS58212
2026-03-30 11:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aad93f9-f648-50e8-8b61-6c91d875900d with scrape type 2
2026-03-30 11:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3aad93f9-f648-50e8-8b61-6c91d875900d with scrape type 2
2026-03-30 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3aad93f9-f648-50e8-8b61-6c91d875900d, identifier: CS58212
2026-03-30 11:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3aad93f9-f648-50e8-8b61-6c91d875900d with identifier: CS58212
2026-03-30 11:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3aad93f9-f648-50e8-8b61-6c91d875900d with identifier: CS58212
2026-03-30 11:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3aad93f9-f648-50e8-8b61-6c91d875900d with identifier: CS58212 to the API
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:37:25Z',
 'fuel_type': 'diesel',
 'id': '3aad93f9-f648-50e8-8b61-6c91d875900d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS58212',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 157190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-01',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS58212%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.es] INFO: Saving data for CS58212: {'auction_closing_time': 1774971445.0, 'created_time': 1774296172.560068, 'last_price_update_time': 1774868513.286329}
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CS58212') HTTP/1.1" 204 0
2026-03-30 11:01:53 [auto1.es] INFO: Found listing with ID: XF92968
2026-03-30 11:01:53 [auto1.es] INFO: Found listing with ID: UF98716
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF98716%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.es] INFO: Scrape type for UF98716: 2
2026-03-30 11:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a4baac8-fd6e-5c62-af6f-aed57f7ef785 with identifier: UF98716
2026-03-30 11:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a4baac8-fd6e-5c62-af6f-aed57f7ef785 with scrape type 2
2026-03-30 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a4baac8-fd6e-5c62-af6f-aed57f7ef785 with scrape type 2
2026-03-30 11:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1a4baac8-fd6e-5c62-af6f-aed57f7ef785, identifier: UF98716
2026-03-30 11:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1a4baac8-fd6e-5c62-af6f-aed57f7ef785 with identifier: UF98716
2026-03-30 11:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1a4baac8-fd6e-5c62-af6f-aed57f7ef785 with identifier: UF98716
2026-03-30 11:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1a4baac8-fd6e-5c62-af6f-aed57f7ef785 with identifier: UF98716 to the API
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:02:41Z',
 'fuel_type': 'petrol',
 'id': '1a4baac8-fd6e-5c62-af6f-aed57f7ef785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF98716',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 28,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-08-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2025}
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF98716%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.es] INFO: Saving data for UF98716: {'auction_closing_time': 1774969361.0, 'created_time': 1774641854.676936, 'last_price_update_time': 1774868513.804783}
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF98716') HTTP/1.1" 204 0
2026-03-30 11:01:53 [auto1.es] INFO: Found listing with ID: DS99682
2026-03-30 11:01:53 [auto1.es] INFO: Found listing with ID: PY38886
2026-03-30 11:01:53 [auto1.es] INFO: Found listing with ID: VY22217
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY22217%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.es] INFO: Scrape type for VY22217: 1
2026-03-30 11:01:53 [auto1.es] INFO: Found listing with ID: JB22846
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB22846%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.es] INFO: Scrape type for JB22846: 1
2026-03-30 11:01:53 [auto1.es] INFO: Found listing with ID: YJ60609
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ60609%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.es] INFO: Scrape type for YJ60609: 2
2026-03-30 11:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8357dffa-ac29-501a-943a-5722231078c7 with identifier: YJ60609
2026-03-30 11:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8357dffa-ac29-501a-943a-5722231078c7 with scrape type 2
2026-03-30 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8357dffa-ac29-501a-943a-5722231078c7 with scrape type 2
2026-03-30 11:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8357dffa-ac29-501a-943a-5722231078c7, identifier: YJ60609
2026-03-30 11:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8357dffa-ac29-501a-943a-5722231078c7 with identifier: YJ60609
2026-03-30 11:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8357dffa-ac29-501a-943a-5722231078c7 with identifier: YJ60609
2026-03-30 11:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8357dffa-ac29-501a-943a-5722231078c7 with identifier: YJ60609 to the API
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:50:22Z',
 'fuel_type': 'hybrid',
 'id': '8357dffa-ac29-501a-943a-5722231078c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ60609',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 73279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ60609%27 HTTP/1.1" 200 None
2026-03-30 11:01:54 [auto1.es] INFO: Saving data for YJ60609: {'auction_closing_time': 1774972222.0, 'created_time': 1773432232.473807, 'last_price_update_time': 1774868514.27183}
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ60609') HTTP/1.1" 204 0
2026-03-30 11:01:54 [auto1.es] INFO: Found listing with ID: FK69974
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK69974%27 HTTP/1.1" 200 None
2026-03-30 11:01:54 [auto1.es] INFO: Scrape type for FK69974: 2
2026-03-30 11:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efaf83b4-ec6f-5d51-92bb-2e6d9d21bd39 with identifier: FK69974
2026-03-30 11:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efaf83b4-ec6f-5d51-92bb-2e6d9d21bd39 with scrape type 2
2026-03-30 11:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efaf83b4-ec6f-5d51-92bb-2e6d9d21bd39 with scrape type 2
2026-03-30 11:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: efaf83b4-ec6f-5d51-92bb-2e6d9d21bd39, identifier: FK69974
2026-03-30 11:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: efaf83b4-ec6f-5d51-92bb-2e6d9d21bd39 with identifier: FK69974
2026-03-30 11:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: efaf83b4-ec6f-5d51-92bb-2e6d9d21bd39 with identifier: FK69974
2026-03-30 11:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: efaf83b4-ec6f-5d51-92bb-2e6d9d21bd39 with identifier: FK69974 to the API
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:17:53Z',
 'fuel_type': 'diesel',
 'id': 'efaf83b4-ec6f-5d51-92bb-2e6d9d21bd39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK69974',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 223195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-22',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK69974%27 HTTP/1.1" 200 None
2026-03-30 11:01:54 [auto1.es] INFO: Saving data for FK69974: {'auction_closing_time': 1774970273.0, 'created_time': 1774296113.083806, 'last_price_update_time': 1774868514.73281}
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK69974') HTTP/1.1" 204 0
2026-03-30 11:01:54 [auto1.es] INFO: Found listing with ID: UJ95411
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ95411%27 HTTP/1.1" 200 None
2026-03-30 11:01:54 [auto1.es] INFO: Scrape type for UJ95411: 1
2026-03-30 11:01:54 [auto1.es] INFO: Found listing with ID: TB20827
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB20827%27 HTTP/1.1" 200 None
2026-03-30 11:01:54 [auto1.es] INFO: Scrape type for TB20827: 2
2026-03-30 11:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abae9e4c-aa7f-54dd-b113-0d2608cfe11d with identifier: TB20827
2026-03-30 11:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abae9e4c-aa7f-54dd-b113-0d2608cfe11d with scrape type 2
2026-03-30 11:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abae9e4c-aa7f-54dd-b113-0d2608cfe11d with scrape type 2
2026-03-30 11:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: abae9e4c-aa7f-54dd-b113-0d2608cfe11d, identifier: TB20827
2026-03-30 11:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: abae9e4c-aa7f-54dd-b113-0d2608cfe11d with identifier: TB20827
2026-03-30 11:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: abae9e4c-aa7f-54dd-b113-0d2608cfe11d with identifier: TB20827
2026-03-30 11:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: abae9e4c-aa7f-54dd-b113-0d2608cfe11d with identifier: TB20827 to the API
2026-03-30 11:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:06:05Z',
 'fuel_type': 'diesel',
 'id': 'abae9e4c-aa7f-54dd-b113-0d2608cfe11d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB20827',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 124532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB20827%27 HTTP/1.1" 200 None
2026-03-30 11:01:55 [auto1.es] INFO: Saving data for TB20827: {'auction_closing_time': 1774969565.0, 'created_time': 1773432240.702911, 'last_price_update_time': 1774868515.197983}
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB20827') HTTP/1.1" 204 0
2026-03-30 11:01:55 [auto1.es] INFO: Found listing with ID: ZX94868
2026-03-30 11:01:55 [auto1.es] INFO: Found listing with ID: JR41621
2026-03-30 11:01:55 [auto1.es] INFO: Found listing with ID: HC78450
2026-03-30 11:01:55 [auto1.es] INFO: Found listing with ID: EW77707
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW77707%27 HTTP/1.1" 200 None
2026-03-30 11:01:55 [auto1.es] INFO: Scrape type for EW77707: 2
2026-03-30 11:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b629ec60-e34e-541e-be65-e6ee5206a919 with identifier: EW77707
2026-03-30 11:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b629ec60-e34e-541e-be65-e6ee5206a919 with scrape type 2
2026-03-30 11:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b629ec60-e34e-541e-be65-e6ee5206a919 with scrape type 2
2026-03-30 11:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b629ec60-e34e-541e-be65-e6ee5206a919, identifier: EW77707
2026-03-30 11:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b629ec60-e34e-541e-be65-e6ee5206a919 with identifier: EW77707
2026-03-30 11:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b629ec60-e34e-541e-be65-e6ee5206a919 with identifier: EW77707
2026-03-30 11:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b629ec60-e34e-541e-be65-e6ee5206a919 with identifier: EW77707 to the API
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:14:26Z',
 'fuel_type': 'diesel',
 'id': 'b629ec60-e34e-541e-be65-e6ee5206a919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW77707',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 60337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-30',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2012}
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW77707%27 HTTP/1.1" 200 None
2026-03-30 11:01:55 [auto1.es] INFO: Saving data for EW77707: {'auction_closing_time': 1774970066.0, 'created_time': 1773144258.698241, 'last_price_update_time': 1774868515.653832}
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EW77707') HTTP/1.1" 204 0
2026-03-30 11:01:55 [auto1.es] INFO: Found listing with ID: VE86539
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE86539%27 HTTP/1.1" 200 None
2026-03-30 11:01:55 [auto1.es] INFO: Scrape type for VE86539: 2
2026-03-30 11:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be79a643-6c59-51e3-ac89-d093d9d260e1 with identifier: VE86539
2026-03-30 11:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be79a643-6c59-51e3-ac89-d093d9d260e1 with scrape type 2
2026-03-30 11:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be79a643-6c59-51e3-ac89-d093d9d260e1 with scrape type 2
2026-03-30 11:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be79a643-6c59-51e3-ac89-d093d9d260e1, identifier: VE86539
2026-03-30 11:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be79a643-6c59-51e3-ac89-d093d9d260e1 with identifier: VE86539
2026-03-30 11:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be79a643-6c59-51e3-ac89-d093d9d260e1 with identifier: VE86539
2026-03-30 11:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be79a643-6c59-51e3-ac89-d093d9d260e1 with identifier: VE86539 to the API
2026-03-30 11:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:46:42Z',
 'fuel_type': 'diesel',
 'id': 'be79a643-6c59-51e3-ac89-d093d9d260e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE86539',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 165940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-24',
 'seller_name': None,
 'title': 'MINI Clubman Cooper SD ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2017}
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE86539%27 HTTP/1.1" 200 None
2026-03-30 11:01:56 [auto1.es] INFO: Saving data for VE86539: {'auction_closing_time': 1774972002.0, 'created_time': 1773432311.135029, 'last_price_update_time': 1774868516.162049}
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VE86539') HTTP/1.1" 204 0
2026-03-30 11:01:56 [auto1.es] INFO: Found listing with ID: GH64040
2026-03-30 11:01:56 [auto1.es] INFO: Found listing with ID: AP30441
2026-03-30 11:01:56 [auto1.es] INFO: Found listing with ID: FK17944
2026-03-30 11:01:56 [auto1.es] INFO: Found listing with ID: US21221
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US21221%27 HTTP/1.1" 200 None
2026-03-30 11:01:56 [auto1.es] INFO: Scrape type for US21221: 2
2026-03-30 11:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba4a314a-4816-5ee6-9844-7132171f7ed0 with identifier: US21221
2026-03-30 11:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba4a314a-4816-5ee6-9844-7132171f7ed0 with scrape type 2
2026-03-30 11:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba4a314a-4816-5ee6-9844-7132171f7ed0 with scrape type 2
2026-03-30 11:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ba4a314a-4816-5ee6-9844-7132171f7ed0, identifier: US21221
2026-03-30 11:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ba4a314a-4816-5ee6-9844-7132171f7ed0 with identifier: US21221
2026-03-30 11:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ba4a314a-4816-5ee6-9844-7132171f7ed0 with identifier: US21221
2026-03-30 11:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ba4a314a-4816-5ee6-9844-7132171f7ed0 with identifier: US21221 to the API
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:01:10Z',
 'fuel_type': 'diesel',
 'id': 'ba4a314a-4816-5ee6-9844-7132171f7ed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US21221',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 73294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US21221%27 HTTP/1.1" 200 None
2026-03-30 11:01:56 [auto1.es] INFO: Saving data for US21221: {'auction_closing_time': 1774969270.0, 'created_time': 1773432278.848295, 'last_price_update_time': 1774868516.668703}
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='US21221') HTTP/1.1" 204 0
2026-03-30 11:01:56 [auto1.es] INFO: Found listing with ID: SB85910
2026-03-30 11:01:56 [auto1.es] INFO: Found listing with ID: FW08254
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW08254%27 HTTP/1.1" 200 None
2026-03-30 11:01:56 [auto1.es] INFO: Scrape type for FW08254: 2
2026-03-30 11:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with identifier: FW08254
2026-03-30 11:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with scrape type 2
2026-03-30 11:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with scrape type 2
2026-03-30 11:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d67dbab-c6cb-5951-a2b3-c789a24f0903, identifier: FW08254
2026-03-30 11:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with identifier: FW08254
2026-03-30 11:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with identifier: FW08254
2026-03-30 11:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with identifier: FW08254 to the API
2026-03-30 11:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:19:23Z',
 'fuel_type': 'diesel',
 'id': '5d67dbab-c6cb-5951-a2b3-c789a24f0903',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW08254',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 79579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2021}
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW08254%27 HTTP/1.1" 200 None
2026-03-30 11:01:57 [auto1.es] INFO: Saving data for FW08254: {'auction_closing_time': 1774970363.0, 'created_time': 1773432316.761987, 'last_price_update_time': 1774868517.150957}
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FW08254') HTTP/1.1" 204 0
2026-03-30 11:01:57 [auto1.es] INFO: Found listing with ID: XG11186
2026-03-30 11:01:57 [auto1.es] INFO: Found listing with ID: PK70837
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK70837%27 HTTP/1.1" 200 None
2026-03-30 11:01:57 [auto1.es] INFO: Scrape type for PK70837: 2
2026-03-30 11:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5ed72be-5d96-5107-a3c8-89e35858c3a0 with identifier: PK70837
2026-03-30 11:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5ed72be-5d96-5107-a3c8-89e35858c3a0 with scrape type 2
2026-03-30 11:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5ed72be-5d96-5107-a3c8-89e35858c3a0 with scrape type 2
2026-03-30 11:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e5ed72be-5d96-5107-a3c8-89e35858c3a0, identifier: PK70837
2026-03-30 11:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e5ed72be-5d96-5107-a3c8-89e35858c3a0 with identifier: PK70837
2026-03-30 11:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e5ed72be-5d96-5107-a3c8-89e35858c3a0 with identifier: PK70837
2026-03-30 11:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e5ed72be-5d96-5107-a3c8-89e35858c3a0 with identifier: PK70837 to the API
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:15:54Z',
 'fuel_type': 'diesel',
 'id': 'e5ed72be-5d96-5107-a3c8-89e35858c3a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK70837',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 266376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK70837%27 HTTP/1.1" 200 None
2026-03-30 11:01:57 [auto1.es] INFO: Saving data for PK70837: {'auction_closing_time': 1774970154.0, 'created_time': 1773345735.039192, 'last_price_update_time': 1774868517.635879}
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK70837') HTTP/1.1" 204 0
2026-03-30 11:01:57 [auto1.es] INFO: Found listing with ID: ND38455
2026-03-30 11:01:57 [auto1.es] INFO: Found listing with ID: EG02791
2026-03-30 11:01:57 [auto1.es] INFO: Found listing with ID: JA56838
2026-03-30 11:01:57 [auto1.es] INFO: Found listing with ID: BB57842
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB57842%27 HTTP/1.1" 200 None
2026-03-30 11:01:57 [auto1.es] INFO: Scrape type for BB57842: 2
2026-03-30 11:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce824588-3e77-517e-b8a4-55fecf870a27 with identifier: BB57842
2026-03-30 11:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce824588-3e77-517e-b8a4-55fecf870a27 with scrape type 2
2026-03-30 11:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce824588-3e77-517e-b8a4-55fecf870a27 with scrape type 2
2026-03-30 11:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce824588-3e77-517e-b8a4-55fecf870a27, identifier: BB57842
2026-03-30 11:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce824588-3e77-517e-b8a4-55fecf870a27 with identifier: BB57842
2026-03-30 11:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce824588-3e77-517e-b8a4-55fecf870a27 with identifier: BB57842
2026-03-30 11:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce824588-3e77-517e-b8a4-55fecf870a27 with identifier: BB57842 to the API
2026-03-30 11:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:12:49Z',
 'fuel_type': 'petrol',
 'id': 'ce824588-3e77-517e-b8a4-55fecf870a27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB57842',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 35534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-02',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 T-GDI N Line',
 'transmission': 'manual',
 'trim': 'N Line',
 'year': 2023}
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB57842%27 HTTP/1.1" 200 None
2026-03-30 11:01:58 [auto1.es] INFO: Saving data for BB57842: {'auction_closing_time': 1774969969.0, 'created_time': 1773345783.418289, 'last_price_update_time': 1774868518.1659}
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB57842') HTTP/1.1" 204 0
2026-03-30 11:01:58 [auto1.es] INFO: Found listing with ID: XJ12820
2026-03-30 11:01:58 [auto1.es] INFO: Found listing with ID: XS07722
2026-03-30 11:01:58 [auto1.es] INFO: Found listing with ID: CS18860
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS18860%27 HTTP/1.1" 200 None
2026-03-30 11:01:58 [auto1.es] INFO: Scrape type for CS18860: 1
2026-03-30 11:01:58 [auto1.es] INFO: Found listing with ID: XJ95833
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ95833%27 HTTP/1.1" 200 None
2026-03-30 11:01:58 [auto1.es] INFO: Scrape type for XJ95833: 1
2026-03-30 11:01:58 [auto1.es] INFO: Found listing with ID: AM60182
2026-03-30 11:01:58 [auto1.es] INFO: Found listing with ID: XB79448
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB79448%27 HTTP/1.1" 200 None
2026-03-30 11:01:58 [auto1.es] INFO: Scrape type for XB79448: 2
2026-03-30 11:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77229b04-dc69-5edd-ad24-3bf36b8e2552 with identifier: XB79448
2026-03-30 11:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77229b04-dc69-5edd-ad24-3bf36b8e2552 with scrape type 2
2026-03-30 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77229b04-dc69-5edd-ad24-3bf36b8e2552 with scrape type 2
2026-03-30 11:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 77229b04-dc69-5edd-ad24-3bf36b8e2552, identifier: XB79448
2026-03-30 11:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 77229b04-dc69-5edd-ad24-3bf36b8e2552 with identifier: XB79448
2026-03-30 11:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 77229b04-dc69-5edd-ad24-3bf36b8e2552 with identifier: XB79448
2026-03-30 11:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 77229b04-dc69-5edd-ad24-3bf36b8e2552 with identifier: XB79448 to the API
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:58:04Z',
 'fuel_type': 'petrol',
 'id': '77229b04-dc69-5edd-ad24-3bf36b8e2552',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB79448',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 34841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-14',
 'seller_name': None,
 'title': 'Citroen C5 X 1.2 PureTech Feel Pack',
 'transmission': 'automatic',
 'trim': 'Feel Pack',
 'year': 2023}
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB79448%27 HTTP/1.1" 200 None
2026-03-30 11:01:58 [auto1.es] INFO: Saving data for XB79448: {'auction_closing_time': 1774972684.0, 'created_time': 1773131037.202544, 'last_price_update_time': 1774868518.756156}
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB79448') HTTP/1.1" 204 0
2026-03-30 11:01:58 [auto1.es] INFO: Found listing with ID: YU50461
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU50461%27 HTTP/1.1" 200 None
2026-03-30 11:01:58 [auto1.es] INFO: Scrape type for YU50461: 2
2026-03-30 11:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c570a259-08f6-5255-a2b6-40e848afe92f with identifier: YU50461
2026-03-30 11:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c570a259-08f6-5255-a2b6-40e848afe92f with scrape type 2
2026-03-30 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c570a259-08f6-5255-a2b6-40e848afe92f with scrape type 2
2026-03-30 11:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c570a259-08f6-5255-a2b6-40e848afe92f, identifier: YU50461
2026-03-30 11:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c570a259-08f6-5255-a2b6-40e848afe92f with identifier: YU50461
2026-03-30 11:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c570a259-08f6-5255-a2b6-40e848afe92f with identifier: YU50461
2026-03-30 11:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c570a259-08f6-5255-a2b6-40e848afe92f with identifier: YU50461 to the API
2026-03-30 11:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:51:18Z',
 'fuel_type': 'diesel',
 'id': 'c570a259-08f6-5255-a2b6-40e848afe92f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU50461',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 181254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU50461%27 HTTP/1.1" 200 None
2026-03-30 11:01:59 [auto1.es] INFO: Saving data for YU50461: {'auction_closing_time': 1774972278.0, 'created_time': 1773133851.970759, 'last_price_update_time': 1774868519.240204}
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU50461') HTTP/1.1" 204 0
2026-03-30 11:01:59 [auto1.es] INFO: Found listing with ID: DA85741
2026-03-30 11:01:59 [auto1.es] INFO: Found listing with ID: ME14626
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME14626%27 HTTP/1.1" 200 None
2026-03-30 11:01:59 [auto1.es] INFO: Scrape type for ME14626: 2
2026-03-30 11:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with identifier: ME14626
2026-03-30 11:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with scrape type 2
2026-03-30 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with scrape type 2
2026-03-30 11:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da, identifier: ME14626
2026-03-30 11:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with identifier: ME14626
2026-03-30 11:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with identifier: ME14626
2026-03-30 11:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with identifier: ME14626 to the API
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-31T15:22:16Z',
 'fuel_type': 'petrol',
 'id': '3ff67fdc-93bd-5f7d-9024-00b0c6c567da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME14626',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 31071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seller_name': None,
 'title': 'Citroen C5 X 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2022}
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME14626%27 HTTP/1.1" 200 None
2026-03-30 11:01:59 [auto1.es] INFO: Saving data for ME14626: {'auction_closing_time': 1774970536.0, 'created_time': 1773131657.215589, 'last_price_update_time': 1774868519.684596}
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ME14626') HTTP/1.1" 204 0
2026-03-30 11:01:59 [auto1.es] INFO: Found listing with ID: CF60022
2026-03-30 11:01:59 [auto1.es] INFO: Found listing with ID: FW49739
2026-03-30 11:01:59 [auto1.es] INFO: Found listing with ID: US78299
2026-03-30 11:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA01743> (referer: https://www.auto1.com/v1/car-details-view/NA01743/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:04 [scrapy.extensions.logstats] INFO: Crawled 35 pages (at 6 pages/min), scraped 54 items (at 14 items/min)
2026-03-30 11:02:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d6da0a-43d3-5dc8-ab33-81fdb4708900 with identifier: NA01743
2026-03-30 11:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900 with scrape type 1
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_534fd1c80bc9870494f2eb5323a669ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_534fd1c80bc9870494f2eb5323a669ae.jpg not downloaded yet
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_fbf815f4d8c40e8ee46e699850eb360a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_fbf815f4d8c40e8ee46e699850eb360a.jpg not downloaded yet
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_950f4d1ddd968103a0d0031f72f1c1a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_950f4d1ddd968103a0d0031f72f1c1a4.jpg not downloaded yet
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_d3cd20a63a1d4935ec8b2f5777cbf920.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_d3cd20a63a1d4935ec8b2f5777cbf920.jpg not downloaded yet
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_4cd8b3dfadc94f4adb7174b76433f619.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_4cd8b3dfadc94f4adb7174b76433f619.jpg not downloaded yet
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_b3a574f86bdb493f1a48fa478c8209e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_b3a574f86bdb493f1a48fa478c8209e5.jpg not downloaded yet
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_3ce47fab49516c8b93c7cff7aa03ee63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_3ce47fab49516c8b93c7cff7aa03ee63.jpg not downloaded yet
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_4e3d1775e812b84f4ca6286d040886b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_4e3d1775e812b84f4ca6286d040886b2.jpg not downloaded yet
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_b76645b432ddea6c79283dc14c35ae49.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_b76645b432ddea6c79283dc14c35ae49.jpg not downloaded yet
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_ba0c87b88e63ad0c59a4febae4357f6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_ba0c87b88e63ad0c59a4febae4357f6a.jpg not downloaded yet
2026-03-30 11:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF63614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_ba0c87b88e63ad0c59a4febae4357f6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb667de10>
2026-03-30 11:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_ba0c87b88e63ad0c59a4febae4357f6a.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_ba0c87b88e63ad0c59a4febae4357f6a.jpg saved to cache
2026-03-30 11:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF71575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_b76645b432ddea6c79283dc14c35ae49.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb661ab10>
2026-03-30 11:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_b76645b432ddea6c79283dc14c35ae49.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_b76645b432ddea6c79283dc14c35ae49.jpg saved to cache
2026-03-30 11:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG30412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_4e3d1775e812b84f4ca6286d040886b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c0c10>
2026-03-30 11:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_4e3d1775e812b84f4ca6286d040886b2.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_4e3d1775e812b84f4ca6286d040886b2.jpg saved to cache
2026-03-30 11:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA14893> (referer: https://www.auto1.com/v1/car-details-view/MA14893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 301196b0-ba6f-5698-b8eb-5d366c6777f0 with identifier: MA14893
2026-03-30 11:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 301196b0-ba6f-5698-b8eb-5d366c6777f0 with scrape type 1
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_53b0171eae7aac6ad4e68873746f30cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_53b0171eae7aac6ad4e68873746f30cb.jpg not downloaded yet
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_b679f1caeb112840b36de3ac09a46c75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_b679f1caeb112840b36de3ac09a46c75.jpg not downloaded yet
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_048ac0b5d0596ccde104f7c550c20cde.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_048ac0b5d0596ccde104f7c550c20cde.jpg not downloaded yet
2026-03-30 11:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_3ce47fab49516c8b93c7cff7aa03ee63.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_1af51652fa11f060fd87f931b3f86320.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1af51652fa11f060fd87f931b3f86320.jpg not downloaded yet
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_8da99db013173062055a1c77b97b3fb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_8da99db013173062055a1c77b97b3fb5.jpg not downloaded yet
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_40719c609469f8a15bbe73fab60b2005.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_40719c609469f8a15bbe73fab60b2005.jpg not downloaded yet
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_1b2b87b659270afe3d03072cb6762d79.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1b2b87b659270afe3d03072cb6762d79.jpg not downloaded yet
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_1cd7a7008dbf31ffff9062f235774405.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1cd7a7008dbf31ffff9062f235774405.jpg not downloaded yet
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_c58441fe3fca6e5b0e5c28d055d7e0cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_c58441fe3fca6e5b0e5c28d055d7e0cb.jpg not downloaded yet
2026-03-30 11:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6500350>
2026-03-30 11:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_3ce47fab49516c8b93c7cff7aa03ee63.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_3ce47fab49516c8b93c7cff7aa03ee63.jpg saved to cache
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_05242466c3417235a0012686512f6fe8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_05242466c3417235a0012686512f6fe8.jpg not downloaded yet
2026-03-30 11:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_048ac0b5d0596ccde104f7c550c20cde.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN23347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_05242466c3417235a0012686512f6fe8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6422ad0>
2026-03-30 11:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_048ac0b5d0596ccde104f7c550c20cde.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_048ac0b5d0596ccde104f7c550c20cde.jpg saved to cache
2026-03-30 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc1ee990>
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_05242466c3417235a0012686512f6fe8.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_05242466c3417235a0012686512f6fe8.jpg saved to cache
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_c58441fe3fca6e5b0e5c28d055d7e0cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1cd7a7008dbf31ffff9062f235774405.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1b2b87b659270afe3d03072cb6762d79.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c2690>
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_c58441fe3fca6e5b0e5c28d055d7e0cb.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_c58441fe3fca6e5b0e5c28d055d7e0cb.jpg saved to cache
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6554b10>
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_1cd7a7008dbf31ffff9062f235774405.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1cd7a7008dbf31ffff9062f235774405.jpg saved to cache
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc2263d0>
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_1b2b87b659270afe3d03072cb6762d79.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1b2b87b659270afe3d03072cb6762d79.jpg saved to cache
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_40719c609469f8a15bbe73fab60b2005.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_8da99db013173062055a1c77b97b3fb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6473f90>
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_40719c609469f8a15bbe73fab60b2005.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_40719c609469f8a15bbe73fab60b2005.jpg saved to cache
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c5150>
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_8da99db013173062055a1c77b97b3fb5.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_8da99db013173062055a1c77b97b3fb5.jpg saved to cache
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1af51652fa11f060fd87f931b3f86320.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_b679f1caeb112840b36de3ac09a46c75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_53b0171eae7aac6ad4e68873746f30cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6508810>
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_1af51652fa11f060fd87f931b3f86320.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1af51652fa11f060fd87f931b3f86320.jpg saved to cache
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fc0f10>
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_b679f1caeb112840b36de3ac09a46c75.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_b679f1caeb112840b36de3ac09a46c75.jpg saved to cache
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6420f50>
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Ffc%252Feffc2e6dd8bdf467ff3e45dffc88b5ff%252Fpa%252FMA14893_53b0171eae7aac6ad4e68873746f30cb.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_53b0171eae7aac6ad4e68873746f30cb.jpg saved to cache
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 301196b0-ba6f-5698-b8eb-5d366c6777f0
2026-03-30 11:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 301196b0-ba6f-5698-b8eb-5d366c6777f0, skipping ID generation
2026-03-30 11:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 301196b0-ba6f-5698-b8eb-5d366c6777f0 with scrape type 1
2026-03-30 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 301196b0-ba6f-5698-b8eb-5d366c6777f0 sending to next pipeline
2026-03-30 11:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 301196b0-ba6f-5698-b8eb-5d366c6777f0, identifier: MA14893
2026-03-30 11:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 301196b0-ba6f-5698-b8eb-5d366c6777f0 with identifier: MA14893
2026-03-30 11:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 301196b0-ba6f-5698-b8eb-5d366c6777f0 with identifier: MA14893
2026-03-30 11:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 301196b0-ba6f-5698-b8eb-5d366c6777f0 with identifier: MA14893 to the API
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_53b0171eae7aac6ad4e68873746f30cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:05:47Z',
 'fuel_type': 'diesel',
 'id': '301196b0-ba6f-5698-b8eb-5d366c6777f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA14893',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 278536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_53b0171eae7aac6ad4e68873746f30cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_b679f1caeb112840b36de3ac09a46c75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_048ac0b5d0596ccde104f7c550c20cde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1af51652fa11f060fd87f931b3f86320.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_8da99db013173062055a1c77b97b3fb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_40719c609469f8a15bbe73fab60b2005.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1b2b87b659270afe3d03072cb6762d79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_1cd7a7008dbf31ffff9062f235774405.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80328,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_c58441fe3fca6e5b0e5c28d055d7e0cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301196b0-ba6f-5698-b8eb-5d366c6777f0/301196b0-ba6f-5698-b8eb-5d366c6777f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/fc/effc2e6dd8bdf467ff3e45dffc88b5ff/pa/MA14893_05242466c3417235a0012686512f6fe8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-04-10',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 D-4D VX',
 'transmission': 'automatic',
 'trim': 'VX',
 'year': 2006}
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA14893%27 HTTP/1.1" 200 None
2026-03-30 11:02:29 [auto1.es] INFO: Saving data for MA14893: {'created_time': 1774868549.508412, 'last_price_update_time': 1774868549.508432, 'auction_closing_time': 1774969547.0}
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MA14893') HTTP/1.1" 204 0
2026-03-30 11:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_b3a574f86bdb493f1a48fa478c8209e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66bd850>
2026-03-30 11:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_b3a574f86bdb493f1a48fa478c8209e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_b3a574f86bdb493f1a48fa478c8209e5.jpg saved to cache
2026-03-30 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_4cd8b3dfadc94f4adb7174b76433f619.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6566750>
2026-03-30 11:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_4cd8b3dfadc94f4adb7174b76433f619.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_4cd8b3dfadc94f4adb7174b76433f619.jpg saved to cache
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_d3cd20a63a1d4935ec8b2f5777cbf920.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66bcd10>
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_d3cd20a63a1d4935ec8b2f5777cbf920.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_d3cd20a63a1d4935ec8b2f5777cbf920.jpg saved to cache
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_950f4d1ddd968103a0d0031f72f1c1a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb643b690>
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_950f4d1ddd968103a0d0031f72f1c1a4.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_950f4d1ddd968103a0d0031f72f1c1a4.jpg saved to cache
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_fbf815f4d8c40e8ee46e699850eb360a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_534fd1c80bc9870494f2eb5323a669ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb650f310>
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_fbf815f4d8c40e8ee46e699850eb360a.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_fbf815f4d8c40e8ee46e699850eb360a.jpg saved to cache
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6566090>
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F36788724af2e3cdbfaf37bdae1b3530a%252Fpa%252FNA01743_534fd1c80bc9870494f2eb5323a669ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_534fd1c80bc9870494f2eb5323a669ae.jpg saved to cache
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900
2026-03-30 11:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8d6da0a-43d3-5dc8-ab33-81fdb4708900, skipping ID generation
2026-03-30 11:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900 with scrape type 1
2026-03-30 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8d6da0a-43d3-5dc8-ab33-81fdb4708900 sending to next pipeline
2026-03-30 11:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8d6da0a-43d3-5dc8-ab33-81fdb4708900, identifier: NA01743
2026-03-30 11:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8d6da0a-43d3-5dc8-ab33-81fdb4708900 with identifier: NA01743
2026-03-30 11:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8d6da0a-43d3-5dc8-ab33-81fdb4708900 with identifier: NA01743
2026-03-30 11:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8d6da0a-43d3-5dc8-ab33-81fdb4708900 with identifier: NA01743 to the API
2026-03-30 11:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_534fd1c80bc9870494f2eb5323a669ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:42:18Z',
 'fuel_type': 'diesel',
 'id': 'c8d6da0a-43d3-5dc8-ab33-81fdb4708900',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA01743',
 'listing': 'auction',
 'location': 'ES, Huelva',
 'make': 'BMW',
 'model': '5er',
 'odometer': 209664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_534fd1c80bc9870494f2eb5323a669ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_fbf815f4d8c40e8ee46e699850eb360a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_950f4d1ddd968103a0d0031f72f1c1a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_d3cd20a63a1d4935ec8b2f5777cbf920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_4cd8b3dfadc94f4adb7174b76433f619.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_b3a574f86bdb493f1a48fa478c8209e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_3ce47fab49516c8b93c7cff7aa03ee63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_4e3d1775e812b84f4ca6286d040886b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_b76645b432ddea6c79283dc14c35ae49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6da0a-43d3-5dc8-ab33-81fdb4708900/c8d6da0a-43d3-5dc8-ab33-81fdb4708900_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/36788724af2e3cdbfaf37bdae1b3530a/pa/NA01743_ba0c87b88e63ad0c59a4febae4357f6a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA01743%27 HTTP/1.1" 200 None
2026-03-30 11:02:31 [auto1.es] INFO: Saving data for NA01743: {'created_time': 1774868551.465015, 'last_price_update_time': 1774868551.46503, 'auction_closing_time': 1774971738.0}
2026-03-30 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA01743') HTTP/1.1" 204 0
2026-03-30 11:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR53173> (referer: https://www.auto1.com/v1/car-details-view/GR53173/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b24c97a0-8e0f-5941-b3d8-116ae9424058 with identifier: GR53173
2026-03-30 11:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b24c97a0-8e0f-5941-b3d8-116ae9424058 with scrape type 1
2026-03-30 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b24c97a0-8e0f-5941-b3d8-116ae9424058
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F67%252Fc167cbd901ec77faa8932f29f4009da6%252Fpa%252FGR53173_849778f3185f9fc8254c895d11e6aa84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_849778f3185f9fc8254c895d11e6aa84.jpg already downloaded
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F67%252Fc167cbd901ec77faa8932f29f4009da6%252Fpa%252FGR53173_e07caff6ee144b3606cf806d2d3a4b12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_e07caff6ee144b3606cf806d2d3a4b12.jpg already downloaded
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F67%252Fc167cbd901ec77faa8932f29f4009da6%252Fpa%252FGR53173_2ecd9be38e1e4631798134f7cdf43179.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_2ecd9be38e1e4631798134f7cdf43179.jpg already downloaded
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F67%252Fc167cbd901ec77faa8932f29f4009da6%252Fpa%252FGR53173_27650d6de2dd586416e800f1ebb95a79.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_27650d6de2dd586416e800f1ebb95a79.jpg already downloaded
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F67%252Fc167cbd901ec77faa8932f29f4009da6%252Fpa%252FGR53173_9018df64aa2c878a5d7608081d5e3ef9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_9018df64aa2c878a5d7608081d5e3ef9.jpg already downloaded
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F67%252Fc167cbd901ec77faa8932f29f4009da6%252Fpa%252FGR53173_2cf7a711e3b3c230bfed85fcc1a38936.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_2cf7a711e3b3c230bfed85fcc1a38936.jpg already downloaded
2026-03-30 11:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b24c97a0-8e0f-5941-b3d8-116ae9424058, identifier: GR53173
2026-03-30 11:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b24c97a0-8e0f-5941-b3d8-116ae9424058 with identifier: GR53173
2026-03-30 11:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b24c97a0-8e0f-5941-b3d8-116ae9424058 with identifier: GR53173
2026-03-30 11:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b24c97a0-8e0f-5941-b3d8-116ae9424058 with identifier: GR53173 to the API
2026-03-30 11:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GR53173>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-31T15:24:12Z',
 'fuel_type': 'petrol',
 'id': 'b24c97a0-8e0f-5941-b3d8-116ae9424058',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR53173',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Ford',
 'model': 'Escort',
 'odometer': 8687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_849778f3185f9fc8254c895d11e6aa84.jpg',
                'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_e07caff6ee144b3606cf806d2d3a4b12.jpg',
                'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_2ecd9be38e1e4631798134f7cdf43179.jpg',
                'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_27650d6de2dd586416e800f1ebb95a79.jpg',
                'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_9018df64aa2c878a5d7608081d5e3ef9.jpg',
                'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_2cf7a711e3b3c230bfed85fcc1a38936.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24c97a0-8e0f-5941-b3d8-116ae9424058/b24c97a0-8e0f-5941-b3d8-116ae9424058_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_849778f3185f9fc8254c895d11e6aa84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24c97a0-8e0f-5941-b3d8-116ae9424058/b24c97a0-8e0f-5941-b3d8-116ae9424058_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_e07caff6ee144b3606cf806d2d3a4b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24c97a0-8e0f-5941-b3d8-116ae9424058/b24c97a0-8e0f-5941-b3d8-116ae9424058_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_2ecd9be38e1e4631798134f7cdf43179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24c97a0-8e0f-5941-b3d8-116ae9424058/b24c97a0-8e0f-5941-b3d8-116ae9424058_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_27650d6de2dd586416e800f1ebb95a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24c97a0-8e0f-5941-b3d8-116ae9424058/b24c97a0-8e0f-5941-b3d8-116ae9424058_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_9018df64aa2c878a5d7608081d5e3ef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24c97a0-8e0f-5941-b3d8-116ae9424058/b24c97a0-8e0f-5941-b3d8-116ae9424058_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/67/c167cbd901ec77faa8932f29f4009da6/pa/GR53173_2cf7a711e3b3c230bfed85fcc1a38936.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1989-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Escort 1.6 CL',
 'transmission': 'manual',
 'trim': 'CL',
 'year': 1989}
2026-03-30 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR53173%27 HTTP/1.1" 200 None
2026-03-30 11:02:33 [auto1.es] INFO: Saving data for GR53173: {'created_time': 1774868553.280836, 'last_price_update_time': 1774868553.280849, 'auction_closing_time': 1774970652.0}
2026-03-30 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GR53173') HTTP/1.1" 204 0
2026-03-30 11:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG08794> (referer: https://www.auto1.com/v1/car-details-view/VG08794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73a46a01-4b0a-5567-8f07-3c5be1103ed0 with identifier: VG08794
2026-03-30 11:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a46a01-4b0a-5567-8f07-3c5be1103ed0 with scrape type 1
2026-03-30 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73a46a01-4b0a-5567-8f07-3c5be1103ed0
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_f1160490966df510640de2c9038a4a46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_f1160490966df510640de2c9038a4a46.jpg already downloaded
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_a00ea0eb5e1aff929fea18291e51bac6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_a00ea0eb5e1aff929fea18291e51bac6.jpg already downloaded
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_9b2dad088f683afc195128a664f9def5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_9b2dad088f683afc195128a664f9def5.jpg already downloaded
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_4ecc63f4a1a81a943a94340d9e36fd35.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_4ecc63f4a1a81a943a94340d9e36fd35.jpg already downloaded
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_5fe54c7e5c3ec91fec0eb91820364753.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_5fe54c7e5c3ec91fec0eb91820364753.jpg already downloaded
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_bcff168b4d7544b98062b8e30d45e73f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_bcff168b4d7544b98062b8e30d45e73f.jpg already downloaded
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_704a28fe91f3fa72c7af85c9ee214182.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_704a28fe91f3fa72c7af85c9ee214182.jpg already downloaded
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_0818ddbc8840d1c19e8a486bf7d23509.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_0818ddbc8840d1c19e8a486bf7d23509.jpg not downloaded yet
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_cce83a103fd93e256737dd523848c9b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_cce83a103fd93e256737dd523848c9b8.jpg already downloaded
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_f4f6581151f226b8f2017d9fa4c92868.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_f4f6581151f226b8f2017d9fa4c92868.jpg already downloaded
2026-03-30 11:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY38329> (referer: https://www.auto1.com/v1/car-details-view/VY38329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46 with identifier: VY38329
2026-03-30 11:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46 with scrape type 1
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_49ba5e4678687a2bf5dcaa3adcb80c4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_49ba5e4678687a2bf5dcaa3adcb80c4a.jpg already downloaded
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_c7f7d701297c2b4152dfe64550f29628.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_c7f7d701297c2b4152dfe64550f29628.jpg already downloaded
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_3240aa7e9af5247d19e9701574f67019.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_3240aa7e9af5247d19e9701574f67019.jpg already downloaded
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_dc27c9f011285c813ad19ec10264e31c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_dc27c9f011285c813ad19ec10264e31c.jpg already downloaded
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_94a0c3bfd20ea8d8636ac82e023e2252.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_94a0c3bfd20ea8d8636ac82e023e2252.jpg already downloaded
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_3d8cdb0f8950e59d7769d44559e13004.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_3d8cdb0f8950e59d7769d44559e13004.jpg already downloaded
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_7596e7d92f2c1eacdf166b7af3d326da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_7596e7d92f2c1eacdf166b7af3d326da.jpg already downloaded
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_8b0364888bf53d91f4d3159244df5f0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_8b0364888bf53d91f4d3159244df5f0c.jpg already downloaded
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_86d0a5d56e880821e19ee9324eb007c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_86d0a5d56e880821e19ee9324eb007c4.jpg already downloaded
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85e9ca6824b582229a921ecd8786f2%252Fpa%252FVY38329_d2b51abfeed356a0ddc2a5f237a2e10b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_d2b51abfeed356a0ddc2a5f237a2e10b.jpg already downloaded
2026-03-30 11:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46, identifier: VY38329
2026-03-30 11:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46 with identifier: VY38329
2026-03-30 11:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46 with identifier: VY38329
2026-03-30 11:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46 with identifier: VY38329 to the API
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VY38329>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:37:25Z',
 'fuel_type': 'diesel',
 'id': '57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY38329',
 'listing': 'auction',
 'location': 'ES, Sabadell',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 157418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_49ba5e4678687a2bf5dcaa3adcb80c4a.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_c7f7d701297c2b4152dfe64550f29628.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_3240aa7e9af5247d19e9701574f67019.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_dc27c9f011285c813ad19ec10264e31c.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_94a0c3bfd20ea8d8636ac82e023e2252.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_3d8cdb0f8950e59d7769d44559e13004.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_7596e7d92f2c1eacdf166b7af3d326da.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_8b0364888bf53d91f4d3159244df5f0c.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_86d0a5d56e880821e19ee9324eb007c4.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_d2b51abfeed356a0ddc2a5f237a2e10b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_49ba5e4678687a2bf5dcaa3adcb80c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_c7f7d701297c2b4152dfe64550f29628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_3240aa7e9af5247d19e9701574f67019.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_dc27c9f011285c813ad19ec10264e31c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_94a0c3bfd20ea8d8636ac82e023e2252.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_3d8cdb0f8950e59d7769d44559e13004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_7596e7d92f2c1eacdf166b7af3d326da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_8b0364888bf53d91f4d3159244df5f0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_86d0a5d56e880821e19ee9324eb007c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46/57cbd6b2-3ca3-5c3e-9e3f-9b036dec8b46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85e9ca6824b582229a921ecd8786f2/pa/VY38329_d2b51abfeed356a0ddc2a5f237a2e10b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY38329%27 HTTP/1.1" 200 None
2026-03-30 11:02:39 [auto1.es] INFO: Saving data for VY38329: {'created_time': 1774868559.034099, 'last_price_update_time': 1774868559.034111, 'auction_closing_time': 1774971445.0}
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY38329') HTTP/1.1" 204 0
2026-03-30 11:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_0818ddbc8840d1c19e8a486bf7d23509.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66bc450>
2026-03-30 11:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F3c%252Fe73ce768f43f766b29d245acbb62dd33%252Fpa%252FVG08794_0818ddbc8840d1c19e8a486bf7d23509.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_0818ddbc8840d1c19e8a486bf7d23509.jpg saved to cache
2026-03-30 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73a46a01-4b0a-5567-8f07-3c5be1103ed0
2026-03-30 11:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73a46a01-4b0a-5567-8f07-3c5be1103ed0, skipping ID generation
2026-03-30 11:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a46a01-4b0a-5567-8f07-3c5be1103ed0 with scrape type 1
2026-03-30 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73a46a01-4b0a-5567-8f07-3c5be1103ed0 sending to next pipeline
2026-03-30 11:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73a46a01-4b0a-5567-8f07-3c5be1103ed0, identifier: VG08794
2026-03-30 11:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73a46a01-4b0a-5567-8f07-3c5be1103ed0 with identifier: VG08794
2026-03-30 11:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73a46a01-4b0a-5567-8f07-3c5be1103ed0 with identifier: VG08794
2026-03-30 11:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73a46a01-4b0a-5567-8f07-3c5be1103ed0 with identifier: VG08794 to the API
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_0818ddbc8840d1c19e8a486bf7d23509.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:10:56Z',
 'fuel_type': 'petrol',
 'id': '73a46a01-4b0a-5567-8f07-3c5be1103ed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG08794',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 159520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_f1160490966df510640de2c9038a4a46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_a00ea0eb5e1aff929fea18291e51bac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_9b2dad088f683afc195128a664f9def5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_4ecc63f4a1a81a943a94340d9e36fd35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_5fe54c7e5c3ec91fec0eb91820364753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_bcff168b4d7544b98062b8e30d45e73f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_704a28fe91f3fa72c7af85c9ee214182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_0818ddbc8840d1c19e8a486bf7d23509.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_cce83a103fd93e256737dd523848c9b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a46a01-4b0a-5567-8f07-3c5be1103ed0/73a46a01-4b0a-5567-8f07-3c5be1103ed0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/3c/e73ce768f43f766b29d245acbb62dd33/pa/VG08794_f4f6581151f226b8f2017d9fa4c92868.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Drive 4x2',
 'transmission': 'manual',
 'trim': 'Drive 4x2',
 'year': 2013}
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG08794%27 HTTP/1.1" 200 None
2026-03-30 11:02:39 [auto1.es] INFO: Saving data for VG08794: {'created_time': 1774868559.620171, 'last_price_update_time': 1774868559.620183, 'auction_closing_time': 1774969856.0}
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VG08794') HTTP/1.1" 204 0
2026-03-30 11:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ95833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF63614> (referer: https://www.auto1.com/v1/car-details-view/YF63614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6cb7971-3102-56a6-acce-b7c0df448b5f with identifier: YF63614
2026-03-30 11:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6cb7971-3102-56a6-acce-b7c0df448b5f with scrape type 1
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_4d386af6b8313fec5996d64d9f66e149.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_4d386af6b8313fec5996d64d9f66e149.jpg not downloaded yet
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_e00c880ac94037f423889e585febd2b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_e00c880ac94037f423889e585febd2b9.jpg not downloaded yet
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_12b254df3cda3b30df82360217a1e14a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_12b254df3cda3b30df82360217a1e14a.jpg not downloaded yet
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_5e9bc622ceb4b9d9341fd4e87a450159.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_5e9bc622ceb4b9d9341fd4e87a450159.jpg not downloaded yet
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_d02666a6509c6c2c38c1b7070d8bc25f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_d02666a6509c6c2c38c1b7070d8bc25f.jpg not downloaded yet
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_8ce99493c64bfc9258d5a6dc9bec2c91.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_8ce99493c64bfc9258d5a6dc9bec2c91.jpg not downloaded yet
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_31f07adec44168d2d17963aebb2219c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_31f07adec44168d2d17963aebb2219c7.jpg not downloaded yet
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_eab9adc3ae9392bffa9a1f9937bd305a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_eab9adc3ae9392bffa9a1f9937bd305a.jpg not downloaded yet
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_493dbdc11fc1c5ed543f73588aade474.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_493dbdc11fc1c5ed543f73588aade474.jpg not downloaded yet
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_6082f69f004591ffb2f10521cf7db661.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_6082f69f004591ffb2f10521cf7db661.jpg not downloaded yet
2026-03-30 11:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF71575> (referer: https://www.auto1.com/v1/car-details-view/PF71575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a33905e5-4b7e-5b0c-b59e-44709e154f20 with identifier: PF71575
2026-03-30 11:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a33905e5-4b7e-5b0c-b59e-44709e154f20 with scrape type 1
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a33905e5-4b7e-5b0c-b59e-44709e154f20
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_6ae58ff166b32ba824df1f639f7ded96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_6ae58ff166b32ba824df1f639f7ded96.jpg already downloaded
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_0b462782b822c1de51cf49dac20749db.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_0b462782b822c1de51cf49dac20749db.jpg already downloaded
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_59067620dd5b5eaebb002a0613149e50.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_59067620dd5b5eaebb002a0613149e50.jpg already downloaded
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_f38edeb21abc2fd0107ef768a6f39df8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_f38edeb21abc2fd0107ef768a6f39df8.jpg already downloaded
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_d57619c4bf07d30efc7ae1e4730b4dc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_d57619c4bf07d30efc7ae1e4730b4dc3.jpg already downloaded
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_ac2e65abf10276f8dd812ab083ed2dc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_ac2e65abf10276f8dd812ab083ed2dc7.jpg already downloaded
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_a1d72d76871124eef6791c6a480cb032.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_a1d72d76871124eef6791c6a480cb032.jpg already downloaded
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_13381f62d86e2f4994cbf90b18c6c9b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_13381f62d86e2f4994cbf90b18c6c9b9.jpg already downloaded
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_9bb0bb7d6cf8144a7b9e21c078d30a33.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_9bb0bb7d6cf8144a7b9e21c078d30a33.jpg already downloaded
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F2d%252Fee2de577d859d67671a0d3d3c91a7f02%252Fpa%252FPF71575_f685c6b9d84b0798dcace2aa86f2b1e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_f685c6b9d84b0798dcace2aa86f2b1e4.jpg already downloaded
2026-03-30 11:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a33905e5-4b7e-5b0c-b59e-44709e154f20, identifier: PF71575
2026-03-30 11:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a33905e5-4b7e-5b0c-b59e-44709e154f20 with identifier: PF71575
2026-03-30 11:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a33905e5-4b7e-5b0c-b59e-44709e154f20 with identifier: PF71575
2026-03-30 11:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a33905e5-4b7e-5b0c-b59e-44709e154f20 with identifier: PF71575 to the API
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PF71575>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:46:37Z',
 'fuel_type': 'petrol',
 'id': 'a33905e5-4b7e-5b0c-b59e-44709e154f20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF71575',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 78388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_6ae58ff166b32ba824df1f639f7ded96.jpg',
                'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_0b462782b822c1de51cf49dac20749db.jpg',
                'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_59067620dd5b5eaebb002a0613149e50.jpg',
                'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_f38edeb21abc2fd0107ef768a6f39df8.jpg',
                'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_d57619c4bf07d30efc7ae1e4730b4dc3.jpg',
                'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_ac2e65abf10276f8dd812ab083ed2dc7.jpg',
                'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_a1d72d76871124eef6791c6a480cb032.jpg',
                'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_13381f62d86e2f4994cbf90b18c6c9b9.jpg',
                'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_9bb0bb7d6cf8144a7b9e21c078d30a33.jpg',
                'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_f685c6b9d84b0798dcace2aa86f2b1e4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_6ae58ff166b32ba824df1f639f7ded96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_0b462782b822c1de51cf49dac20749db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_59067620dd5b5eaebb002a0613149e50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_f38edeb21abc2fd0107ef768a6f39df8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_d57619c4bf07d30efc7ae1e4730b4dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_ac2e65abf10276f8dd812ab083ed2dc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_a1d72d76871124eef6791c6a480cb032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_13381f62d86e2f4994cbf90b18c6c9b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_9bb0bb7d6cf8144a7b9e21c078d30a33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a33905e5-4b7e-5b0c-b59e-44709e154f20/a33905e5-4b7e-5b0c-b59e-44709e154f20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/2d/ee2de577d859d67671a0d3d3c91a7f02/pa/PF71575_f685c6b9d84b0798dcace2aa86f2b1e4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style Plus',
 'transmission': 'manual',
 'trim': 'Style Plus',
 'year': 2017}
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF71575%27 HTTP/1.1" 200 None
2026-03-30 11:02:51 [auto1.es] INFO: Saving data for PF71575: {'created_time': 1774868571.648209, 'last_price_update_time': 1774868571.648221, 'auction_closing_time': 1774971997.0}
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PF71575') HTTP/1.1" 204 0
2026-03-30 11:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_6082f69f004591ffb2f10521cf7db661.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6470650>
2026-03-30 11:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_6082f69f004591ffb2f10521cf7db661.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_6082f69f004591ffb2f10521cf7db661.jpg saved to cache
2026-03-30 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_493dbdc11fc1c5ed543f73588aade474.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6658cd0>
2026-03-30 11:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_493dbdc11fc1c5ed543f73588aade474.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_493dbdc11fc1c5ed543f73588aade474.jpg saved to cache
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_eab9adc3ae9392bffa9a1f9937bd305a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb667d810>
2026-03-30 11:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_eab9adc3ae9392bffa9a1f9937bd305a.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_eab9adc3ae9392bffa9a1f9937bd305a.jpg saved to cache
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG30412> (referer: https://www.auto1.com/v1/car-details-view/EG30412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_31f07adec44168d2d17963aebb2219c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_d02666a6509c6c2c38c1b7070d8bc25f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f52c162d-e784-53f2-8f60-788614d2fb73 with identifier: EG30412
2026-03-30 11:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f52c162d-e784-53f2-8f60-788614d2fb73 with scrape type 1
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f52c162d-e784-53f2-8f60-788614d2fb73
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c73b8d58608e6e60d635af970d169e%252Fpa%252FEG30412_3ec671c9059b3a4750aa7b367b1a40f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_3ec671c9059b3a4750aa7b367b1a40f9.jpg already downloaded
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c73b8d58608e6e60d635af970d169e%252Fpa%252FEG30412_f3805098549f63ffc60e29b74ca4c193.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_f3805098549f63ffc60e29b74ca4c193.jpg already downloaded
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c73b8d58608e6e60d635af970d169e%252Fpa%252FEG30412_af3c8a9ee64252e39c08634209216d35.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_af3c8a9ee64252e39c08634209216d35.jpg already downloaded
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c73b8d58608e6e60d635af970d169e%252Fpa%252FEG30412_811fd4eb6af758216f8e7b581358fdee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_811fd4eb6af758216f8e7b581358fdee.jpg already downloaded
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c73b8d58608e6e60d635af970d169e%252Fpa%252FEG30412_3400d7f4d9fcc84f56b9f77820dcf4ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_3400d7f4d9fcc84f56b9f77820dcf4ed.jpg already downloaded
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c73b8d58608e6e60d635af970d169e%252Fpa%252FEG30412_50ad63d8d1fabd732061ad96d2ba0ea3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_50ad63d8d1fabd732061ad96d2ba0ea3.jpg already downloaded
2026-03-30 11:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f52c162d-e784-53f2-8f60-788614d2fb73, identifier: EG30412
2026-03-30 11:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f52c162d-e784-53f2-8f60-788614d2fb73 with identifier: EG30412
2026-03-30 11:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f52c162d-e784-53f2-8f60-788614d2fb73 with identifier: EG30412
2026-03-30 11:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f52c162d-e784-53f2-8f60-788614d2fb73 with identifier: EG30412 to the API
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EG30412>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:05:15Z',
 'fuel_type': 'diesel',
 'id': 'f52c162d-e784-53f2-8f60-788614d2fb73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG30412',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 282137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_3ec671c9059b3a4750aa7b367b1a40f9.jpg',
                'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_f3805098549f63ffc60e29b74ca4c193.jpg',
                'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_af3c8a9ee64252e39c08634209216d35.jpg',
                'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_811fd4eb6af758216f8e7b581358fdee.jpg',
                'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_3400d7f4d9fcc84f56b9f77820dcf4ed.jpg',
                'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_50ad63d8d1fabd732061ad96d2ba0ea3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f52c162d-e784-53f2-8f60-788614d2fb73/f52c162d-e784-53f2-8f60-788614d2fb73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_3ec671c9059b3a4750aa7b367b1a40f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f52c162d-e784-53f2-8f60-788614d2fb73/f52c162d-e784-53f2-8f60-788614d2fb73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_f3805098549f63ffc60e29b74ca4c193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f52c162d-e784-53f2-8f60-788614d2fb73/f52c162d-e784-53f2-8f60-788614d2fb73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_af3c8a9ee64252e39c08634209216d35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f52c162d-e784-53f2-8f60-788614d2fb73/f52c162d-e784-53f2-8f60-788614d2fb73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_811fd4eb6af758216f8e7b581358fdee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f52c162d-e784-53f2-8f60-788614d2fb73/f52c162d-e784-53f2-8f60-788614d2fb73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_3400d7f4d9fcc84f56b9f77820dcf4ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f52c162d-e784-53f2-8f60-788614d2fb73/f52c162d-e784-53f2-8f60-788614d2fb73_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c73b8d58608e6e60d635af970d169e/pa/EG30412_50ad63d8d1fabd732061ad96d2ba0ea3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG30412%27 HTTP/1.1" 200 None
2026-03-30 11:02:54 [auto1.es] INFO: Saving data for EG30412: {'created_time': 1774868574.052038, 'last_price_update_time': 1774868574.052051, 'auction_closing_time': 1774969515.0}
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG30412') HTTP/1.1" 204 0
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc1eec50>
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_31f07adec44168d2d17963aebb2219c7.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_31f07adec44168d2d17963aebb2219c7.jpg saved to cache
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_8ce99493c64bfc9258d5a6dc9bec2c91.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_5e9bc622ceb4b9d9341fd4e87a450159.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 21.579(s), this was the 1st time calling it.
2026-03-30 11:02:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.545201051720899 seconds as it raised RequestError: RequestError: 520, message=, headers=<CIMultiDictProxy('Date': 'Mon, 30 Mar 2026 11:02:53 GMT', 'Content-Type': 'application/problem+json', 'Content-Length': '214', 'Connection': 'keep-alive', 'Retry-After': '60', 'Request-Id': 'fe97524e750e4b0c6f73725e91ce625e', 'Vary': 'Accept-Encoding', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Expose-Headers': '*, X-Project-Key', 'Access-Control-Allow-Methods': 'GET, PUT, POST, DELETE, PATCH, OPTIONS', 'Access-Control-Allow-Headers': 'DNT, Keep-Alive, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization, X-Project-Key', 'Access-Control-Max-Age': '1728000')>, body=b'{"type":"/download/temporary-error","title":"Website Ban","status":520,"detail":"Zyte API could not get a ban-free response in a reasonable time. See https://docs.zyte.com/zyte-api/usage/errors.html#ban-responses"}', request_id=fe97524e750e4b0c6f73725e91ce625e.
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd3e4bd0>
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_d02666a6509c6c2c38c1b7070d8bc25f.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_d02666a6509c6c2c38c1b7070d8bc25f.jpg saved to cache
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66bc710>
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_8ce99493c64bfc9258d5a6dc9bec2c91.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_8ce99493c64bfc9258d5a6dc9bec2c91.jpg saved to cache
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb669fd50>
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_5e9bc622ceb4b9d9341fd4e87a450159.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_5e9bc622ceb4b9d9341fd4e87a450159.jpg saved to cache
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_e00c880ac94037f423889e585febd2b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_12b254df3cda3b30df82360217a1e14a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_4d386af6b8313fec5996d64d9f66e149.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6438590>
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_e00c880ac94037f423889e585febd2b9.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_e00c880ac94037f423889e585febd2b9.jpg saved to cache
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f4d610>
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_12b254df3cda3b30df82360217a1e14a.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_12b254df3cda3b30df82360217a1e14a.jpg saved to cache
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6603b50>
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12013447180dd588633730251ecf8881%252Fpa%252FYF63614_4d386af6b8313fec5996d64d9f66e149.jpg') HTTP/1.1" 204 0
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_4d386af6b8313fec5996d64d9f66e149.jpg saved to cache
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6cb7971-3102-56a6-acce-b7c0df448b5f
2026-03-30 11:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6cb7971-3102-56a6-acce-b7c0df448b5f, skipping ID generation
2026-03-30 11:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6cb7971-3102-56a6-acce-b7c0df448b5f with scrape type 1
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6cb7971-3102-56a6-acce-b7c0df448b5f sending to next pipeline
2026-03-30 11:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6cb7971-3102-56a6-acce-b7c0df448b5f, identifier: YF63614
2026-03-30 11:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6cb7971-3102-56a6-acce-b7c0df448b5f with identifier: YF63614
2026-03-30 11:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6cb7971-3102-56a6-acce-b7c0df448b5f with identifier: YF63614
2026-03-30 11:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6cb7971-3102-56a6-acce-b7c0df448b5f with identifier: YF63614 to the API
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_4d386af6b8313fec5996d64d9f66e149.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:11:36Z',
 'fuel_type': 'petrol',
 'id': 'd6cb7971-3102-56a6-acce-b7c0df448b5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF63614',
 'listing': 'auction',
 'location': 'ES, Rubí',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 174683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_4d386af6b8313fec5996d64d9f66e149.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_e00c880ac94037f423889e585febd2b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_12b254df3cda3b30df82360217a1e14a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_5e9bc622ceb4b9d9341fd4e87a450159.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_d02666a6509c6c2c38c1b7070d8bc25f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_8ce99493c64bfc9258d5a6dc9bec2c91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_31f07adec44168d2d17963aebb2219c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_eab9adc3ae9392bffa9a1f9937bd305a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_493dbdc11fc1c5ed543f73588aade474.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cb7971-3102-56a6-acce-b7c0df448b5f/d6cb7971-3102-56a6-acce-b7c0df448b5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12013447180dd588633730251ecf8881/pa/YF63614_6082f69f004591ffb2f10521cf7db661.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF63614%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [auto1.es] INFO: Saving data for YF63614: {'created_time': 1774868575.147549, 'last_price_update_time': 1774868575.147562, 'auction_closing_time': 1774969896.0}
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YF63614') HTTP/1.1" 204 0
2026-03-30 11:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN23347> (referer: https://www.auto1.com/v1/car-details-view/JN23347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd23239-a357-564f-bab5-f7fc053832f9 with identifier: JN23347
2026-03-30 11:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd23239-a357-564f-bab5-f7fc053832f9 with scrape type 1
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efd23239-a357-564f-bab5-f7fc053832f9
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_5dfaaa2cea02ad9f61471e4fddf1d5e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_5dfaaa2cea02ad9f61471e4fddf1d5e6.jpg already downloaded
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_1a7bdde82954ebd0c5076ba79f284569.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_1a7bdde82954ebd0c5076ba79f284569.jpg already downloaded
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_da0954042d6be02b441396f750415719.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_da0954042d6be02b441396f750415719.jpg already downloaded
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_59a2e1896cd11b8922d56dfdb33eaab2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_59a2e1896cd11b8922d56dfdb33eaab2.jpg already downloaded
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_f7b718a90868c808a5853bd1e46018ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_f7b718a90868c808a5853bd1e46018ff.jpg already downloaded
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_e8ce27b805cb4b997c75c826a21424a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_e8ce27b805cb4b997c75c826a21424a4.jpg already downloaded
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_d5b37510dae35d0b197d3a43d1fe8479.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_d5b37510dae35d0b197d3a43d1fe8479.jpg already downloaded
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_ee31152bff7856de2846d3bfc3179f28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_ee31152bff7856de2846d3bfc3179f28.jpg already downloaded
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_49c68916ac775964192909e61cdf6b64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_49c68916ac775964192909e61cdf6b64.jpg already downloaded
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b1b83b3e03d879ecdab2ab468d0e98%252Fpa%252FJN23347_4ac678848ad1ccc138426cf836a04ead.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_4ac678848ad1ccc138426cf836a04ead.jpg already downloaded
2026-03-30 11:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: efd23239-a357-564f-bab5-f7fc053832f9, identifier: JN23347
2026-03-30 11:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: efd23239-a357-564f-bab5-f7fc053832f9 with identifier: JN23347
2026-03-30 11:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: efd23239-a357-564f-bab5-f7fc053832f9 with identifier: JN23347
2026-03-30 11:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: efd23239-a357-564f-bab5-f7fc053832f9 with identifier: JN23347 to the API
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JN23347>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:00:15Z',
 'fuel_type': 'diesel',
 'id': 'efd23239-a357-564f-bab5-f7fc053832f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN23347',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 141600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_5dfaaa2cea02ad9f61471e4fddf1d5e6.jpg',
                'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_1a7bdde82954ebd0c5076ba79f284569.jpg',
                'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_da0954042d6be02b441396f750415719.jpg',
                'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_59a2e1896cd11b8922d56dfdb33eaab2.jpg',
                'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_f7b718a90868c808a5853bd1e46018ff.jpg',
                'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_e8ce27b805cb4b997c75c826a21424a4.jpg',
                'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_d5b37510dae35d0b197d3a43d1fe8479.jpg',
                'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_ee31152bff7856de2846d3bfc3179f28.jpg',
                'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_49c68916ac775964192909e61cdf6b64.jpg',
                'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_4ac678848ad1ccc138426cf836a04ead.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_5dfaaa2cea02ad9f61471e4fddf1d5e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_1a7bdde82954ebd0c5076ba79f284569.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_da0954042d6be02b441396f750415719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_59a2e1896cd11b8922d56dfdb33eaab2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_f7b718a90868c808a5853bd1e46018ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_e8ce27b805cb4b997c75c826a21424a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_d5b37510dae35d0b197d3a43d1fe8479.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_ee31152bff7856de2846d3bfc3179f28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_49c68916ac775964192909e61cdf6b64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd23239-a357-564f-bab5-f7fc053832f9/efd23239-a357-564f-bab5-f7fc053832f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b1b83b3e03d879ecdab2ab468d0e98/pa/JN23347_4ac678848ad1ccc138426cf836a04ead.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Shine XL',
 'transmission': 'manual',
 'trim': 'Shine XL',
 'year': 2020}
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN23347%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [auto1.es] INFO: Saving data for JN23347: {'created_time': 1774868575.938846, 'last_price_update_time': 1774868575.938858, 'auction_closing_time': 1774969215.0}
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JN23347') HTTP/1.1" 204 0
2026-03-30 11:02:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.452(s), this was the 1st time calling it.
2026-03-30 11:02:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.920011653267714 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:02:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.563(s), this was the 1st time calling it.
2026-03-30 11:02:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.238596175895643 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:02:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.535(s), this was the 1st time calling it.
2026-03-30 11:02:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.263237529159847 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:02:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.558(s), this was the 1st time calling it.
2026-03-30 11:02:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.3274366411008325 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.248(s), this was the 1st time calling it.
2026-03-30 11:03:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.29948776947982 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:04 [scrapy.extensions.logstats] INFO: Crawled 48 pages (at 13 pages/min), scraped 63 items (at 9 items/min)
2026-03-30 11:03:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 35.497(s), this was the 2nd time calling it.
2026-03-30 11:03:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.579035024221273 seconds as it raised RequestError: RequestError: 520, message=, headers=<CIMultiDictProxy('Date': 'Mon, 30 Mar 2026 11:03:07 GMT', 'Content-Type': 'application/problem+json', 'Content-Length': '214', 'Connection': 'keep-alive', 'Retry-After': '60', 'Request-Id': '746be858434edcc947a1ad30bb867e6e', 'Vary': 'Accept-Encoding', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Expose-Headers': '*, X-Project-Key', 'Access-Control-Allow-Methods': 'GET, PUT, POST, DELETE, PATCH, OPTIONS', 'Access-Control-Allow-Headers': 'DNT, Keep-Alive, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization, X-Project-Key', 'Access-Control-Max-Age': '1728000')>, body=b'{"type":"/download/temporary-error","title":"Website Ban","status":520,"detail":"Zyte API could not get a ban-free response in a reasonable time. See https://docs.zyte.com/zyte-api/usage/errors.html#ban-responses"}', request_id=746be858434edcc947a1ad30bb867e6e.
2026-03-30 11:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY14262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ95411/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:04 [scrapy.extensions.logstats] INFO: Crawled 50 pages (at 2 pages/min), scraped 63 items (at 0 items/min)
2026-03-30 11:04:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD80422/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 109.565(s), this was the 3rd time calling it.
2026-03-30 11:04:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 9.26208764756014 seconds as it raised RequestError: RequestError: 520, message=, headers=<CIMultiDictProxy('Date': 'Mon, 30 Mar 2026 11:04:22 GMT', 'Content-Type': 'application/problem+json', 'Content-Length': '214', 'Connection': 'keep-alive', 'Retry-After': '60', 'Request-Id': 'a8b0035ccab3ec27822642a6cdf19bac', 'Vary': 'Accept-Encoding', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Expose-Headers': '*, X-Project-Key', 'Access-Control-Allow-Methods': 'GET, PUT, POST, DELETE, PATCH, OPTIONS', 'Access-Control-Allow-Headers': 'DNT, Keep-Alive, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization, X-Project-Key', 'Access-Control-Max-Age': '1728000')>, body=b'{"type":"/download/temporary-error","title":"Website Ban","status":520,"detail":"Zyte API could not get a ban-free response in a reasonable time. See https://docs.zyte.com/zyte-api/usage/errors.html#ban-responses"}', request_id=a8b0035ccab3ec27822642a6cdf19bac.
2026-03-30 11:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB22846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 127.003(s), this was the 4th time calling it.
2026-03-30 11:04:39 [scrapy_zyte_api.handler] DEBUG: Got Zyte API error (status=520, type='/download/temporary-error', request_id='741eea78baea52b4f53bd0870763e827') while processing URL (https://www.auto1.com/en/app/merchant/car/XC72972): Zyte API could not get a ban-free response in a reasonable time. See https://docs.zyte.com/zyte-api/usage/errors.html#ban-responses
2026-03-30 11:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:39 [auto1.es] ERROR: Request failed: RequestError: 520, message=, headers=<CIMultiDictProxy('Date': 'Mon, 30 Mar 2026 11:04:39 GMT', 'Content-Type': 'application/problem+json', 'Content-Length': '214', 'Connection': 'keep-alive', 'Retry-After': '60', 'Request-Id': '741eea78baea52b4f53bd0870763e827', 'Vary': 'Accept-Encoding', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Expose-Headers': '*, X-Project-Key', 'Access-Control-Allow-Methods': 'GET, PUT, POST, DELETE, PATCH, OPTIONS', 'Access-Control-Allow-Headers': 'DNT, Keep-Alive, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization, X-Project-Key', 'Access-Control-Max-Age': '1728000')>, body=b'{"type":"/download/temporary-error","title":"Website Ban","status":520,"detail":"Zyte API could not get a ban-free response in a reasonable time. See https://docs.zyte.com/zyte-api/usage/errors.html#ban-responses"}', request_id=741eea78baea52b4f53bd0870763e827
2026-03-30 11:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ95833> (referer: https://www.auto1.com/v1/car-details-view/XJ95833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd1b63a-1c16-55ff-be58-2f8b11cb614a with identifier: XJ95833
2026-03-30 11:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd1b63a-1c16-55ff-be58-2f8b11cb614a with scrape type 1
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fd1b63a-1c16-55ff-be58-2f8b11cb614a
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_4223339f2568249a2acb715745c45c25.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_4223339f2568249a2acb715745c45c25.jpg already downloaded
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_6a88395db9af9055f8ca3e0056b515e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_6a88395db9af9055f8ca3e0056b515e0.jpg already downloaded
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_d59ddcbaa146980c5a46e679f706642e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_d59ddcbaa146980c5a46e679f706642e.jpg already downloaded
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_04548f777cdc153e065942030132c3cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_04548f777cdc153e065942030132c3cd.jpg already downloaded
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_1f8ee8adf13b5ca23d230d2dc5d96925.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_1f8ee8adf13b5ca23d230d2dc5d96925.jpg already downloaded
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_ba476669cefc3056e78c329640e13e5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_ba476669cefc3056e78c329640e13e5d.jpg already downloaded
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_28ce45714139ec5d3a7f4e9033408784.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_28ce45714139ec5d3a7f4e9033408784.jpg already downloaded
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_46ea5e874b61abc977cb1dff0f2505a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_46ea5e874b61abc977cb1dff0f2505a2.jpg already downloaded
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_f38e8ce9e1639e48baee39dc30080bd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_f38e8ce9e1639e48baee39dc30080bd6.jpg already downloaded
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fb2%252F72b27babb1dc9d91435f36eee4cb5616%252Fpa%252FXJ95833_e81d20df1ac764c298a5df68346f4c7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_e81d20df1ac764c298a5df68346f4c7f.jpg already downloaded
2026-03-30 11:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7fd1b63a-1c16-55ff-be58-2f8b11cb614a, identifier: XJ95833
2026-03-30 11:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7fd1b63a-1c16-55ff-be58-2f8b11cb614a with identifier: XJ95833
2026-03-30 11:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7fd1b63a-1c16-55ff-be58-2f8b11cb614a with identifier: XJ95833
2026-03-30 11:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7fd1b63a-1c16-55ff-be58-2f8b11cb614a with identifier: XJ95833 to the API
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XJ95833>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:25:00Z',
 'fuel_type': 'diesel',
 'id': '7fd1b63a-1c16-55ff-be58-2f8b11cb614a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ95833',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 194965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_4223339f2568249a2acb715745c45c25.jpg',
                'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_6a88395db9af9055f8ca3e0056b515e0.jpg',
                'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_d59ddcbaa146980c5a46e679f706642e.jpg',
                'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_04548f777cdc153e065942030132c3cd.jpg',
                'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_1f8ee8adf13b5ca23d230d2dc5d96925.jpg',
                'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_ba476669cefc3056e78c329640e13e5d.jpg',
                'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_28ce45714139ec5d3a7f4e9033408784.jpg',
                'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_46ea5e874b61abc977cb1dff0f2505a2.jpg',
                'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_f38e8ce9e1639e48baee39dc30080bd6.jpg',
                'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_e81d20df1ac764c298a5df68346f4c7f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_4223339f2568249a2acb715745c45c25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_6a88395db9af9055f8ca3e0056b515e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_d59ddcbaa146980c5a46e679f706642e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_04548f777cdc153e065942030132c3cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_1f8ee8adf13b5ca23d230d2dc5d96925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_ba476669cefc3056e78c329640e13e5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_28ce45714139ec5d3a7f4e9033408784.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_46ea5e874b61abc977cb1dff0f2505a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_f38e8ce9e1639e48baee39dc30080bd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd1b63a-1c16-55ff-be58-2f8b11cb614a/7fd1b63a-1c16-55ff-be58-2f8b11cb614a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/b2/72b27babb1dc9d91435f36eee4cb5616/pa/XJ95833_e81d20df1ac764c298a5df68346f4c7f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ95833%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.es] INFO: Saving data for XJ95833: {'created_time': 1774868681.991842, 'last_price_update_time': 1774868681.991855, 'auction_closing_time': 1774970700.0}
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ95833') HTTP/1.1" 204 0
2026-03-30 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:42 [auto1.es] INFO: Channel: 24h | Page: 5 | totalHits: 2193 | hits on page: 40
2026-03-30 11:04:42 [auto1.es] INFO: Found listing with ID: US78299
2026-03-30 11:04:42 [auto1.es] INFO: Found listing with ID: HF43157
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF43157%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [auto1.es] INFO: Scrape type for HF43157: 2
2026-03-30 11:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with identifier: HF43157
2026-03-30 11:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with scrape type 2
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with scrape type 2
2026-03-30 11:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef, identifier: HF43157
2026-03-30 11:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with identifier: HF43157
2026-03-30 11:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with identifier: HF43157
2026-03-30 11:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with identifier: HF43157 to the API
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:40:14Z',
 'fuel_type': 'petrol',
 'id': '25c1b16f-dd3b-52ab-80bd-99c9e32107ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF43157',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 67857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF43157%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [auto1.es] INFO: Saving data for HF43157: {'auction_closing_time': 1774971614.0, 'created_time': 1773130930.328798, 'last_price_update_time': 1774868682.522046}
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HF43157') HTTP/1.1" 204 0
2026-03-30 11:04:42 [auto1.es] INFO: Found listing with ID: WS41958
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS41958%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [auto1.es] INFO: Scrape type for WS41958: 1
2026-03-30 11:04:42 [auto1.es] INFO: Found listing with ID: RD87944
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD87944%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [auto1.es] INFO: Scrape type for RD87944: 2
2026-03-30 11:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with identifier: RD87944
2026-03-30 11:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with scrape type 2
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with scrape type 2
2026-03-30 11:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019, identifier: RD87944
2026-03-30 11:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with identifier: RD87944
2026-03-30 11:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with identifier: RD87944
2026-03-30 11:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with identifier: RD87944 to the API
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:08:42Z',
 'fuel_type': 'hybrid',
 'id': '1fcd97d9-b2f1-5748-9e6b-4a3b890e7019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD87944',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 30129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-03',
 'seller_name': None,
 'title': 'Citroen C5 X 1.6 Plug-in Hybrid Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2022}
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD87944%27 HTTP/1.1" 200 None
2026-03-30 11:04:43 [auto1.es] INFO: Saving data for RD87944: {'auction_closing_time': 1774969722.0, 'created_time': 1773130927.242682, 'last_price_update_time': 1774868683.012041}
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD87944') HTTP/1.1" 204 0
2026-03-30 11:04:43 [auto1.es] INFO: Found listing with ID: TW64158
2026-03-30 11:04:43 [auto1.es] INFO: Found listing with ID: JZ31691
2026-03-30 11:04:43 [auto1.es] INFO: Found listing with ID: FG19732
2026-03-30 11:04:43 [auto1.es] INFO: Found listing with ID: VG19882
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19882%27 HTTP/1.1" 200 None
2026-03-30 11:04:43 [auto1.es] INFO: Scrape type for VG19882: 2
2026-03-30 11:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd8b05f-9744-5e34-beb1-2258dd3a9e5d with identifier: VG19882
2026-03-30 11:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd8b05f-9744-5e34-beb1-2258dd3a9e5d with scrape type 2
2026-03-30 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfd8b05f-9744-5e34-beb1-2258dd3a9e5d with scrape type 2
2026-03-30 11:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bfd8b05f-9744-5e34-beb1-2258dd3a9e5d, identifier: VG19882
2026-03-30 11:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bfd8b05f-9744-5e34-beb1-2258dd3a9e5d with identifier: VG19882
2026-03-30 11:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bfd8b05f-9744-5e34-beb1-2258dd3a9e5d with identifier: VG19882
2026-03-30 11:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bfd8b05f-9744-5e34-beb1-2258dd3a9e5d with identifier: VG19882 to the API
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:41:18Z',
 'fuel_type': 'diesel',
 'id': 'bfd8b05f-9744-5e34-beb1-2258dd3a9e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG19882',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 448277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-05',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19882%27 HTTP/1.1" 200 None
2026-03-30 11:04:43 [auto1.es] INFO: Saving data for VG19882: {'auction_closing_time': 1774971678.0, 'created_time': 1773133360.99132, 'last_price_update_time': 1774868683.490323}
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VG19882') HTTP/1.1" 204 0
2026-03-30 11:04:43 [auto1.es] INFO: Found listing with ID: PX05110
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX05110%27 HTTP/1.1" 200 None
2026-03-30 11:04:43 [auto1.es] INFO: Scrape type for PX05110: 2
2026-03-30 11:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with identifier: PX05110
2026-03-30 11:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with scrape type 2
2026-03-30 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with scrape type 2
2026-03-30 11:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f, identifier: PX05110
2026-03-30 11:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with identifier: PX05110
2026-03-30 11:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with identifier: PX05110
2026-03-30 11:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with identifier: PX05110 to the API
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:36:51Z',
 'fuel_type': 'diesel',
 'id': 'bd10ddb2-5b45-5b55-9fff-3741d70f0c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX05110',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 85001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Shine M',
 'transmission': 'manual',
 'trim': 'Shine M',
 'year': 2020}
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX05110%27 HTTP/1.1" 200 None
2026-03-30 11:04:43 [auto1.es] INFO: Saving data for PX05110: {'auction_closing_time': 1774971411.0, 'created_time': 1773131102.260455, 'last_price_update_time': 1774868683.962268}
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PX05110') HTTP/1.1" 204 0
2026-03-30 11:04:43 [auto1.es] INFO: Found listing with ID: PM42549
2026-03-30 11:04:43 [auto1.es] INFO: Found listing with ID: VK69645
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK69645%27 HTTP/1.1" 200 None
2026-03-30 11:04:43 [auto1.es] INFO: Scrape type for VK69645: 2
2026-03-30 11:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd6143ee-faf0-50d6-8c68-297e26384a8a with identifier: VK69645
2026-03-30 11:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd6143ee-faf0-50d6-8c68-297e26384a8a with scrape type 2
2026-03-30 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd6143ee-faf0-50d6-8c68-297e26384a8a with scrape type 2
2026-03-30 11:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd6143ee-faf0-50d6-8c68-297e26384a8a, identifier: VK69645
2026-03-30 11:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd6143ee-faf0-50d6-8c68-297e26384a8a with identifier: VK69645
2026-03-30 11:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd6143ee-faf0-50d6-8c68-297e26384a8a with identifier: VK69645
2026-03-30 11:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd6143ee-faf0-50d6-8c68-297e26384a8a with identifier: VK69645 to the API
2026-03-30 11:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:52:32Z',
 'fuel_type': 'diesel',
 'id': 'fd6143ee-faf0-50d6-8c68-297e26384a8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK69645',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 15160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-18',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2026-03-30 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK69645%27 HTTP/1.1" 200 None
2026-03-30 11:04:44 [auto1.es] INFO: Saving data for VK69645: {'auction_closing_time': 1774972352.0, 'created_time': 1773130915.042136, 'last_price_update_time': 1774868684.859166}
2026-03-30 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VK69645') HTTP/1.1" 204 0
2026-03-30 11:04:44 [auto1.es] INFO: Found listing with ID: YT36266
2026-03-30 11:04:44 [auto1.es] INFO: Found listing with ID: NN28025
2026-03-30 11:04:44 [auto1.es] INFO: Found listing with ID: EN32990
2026-03-30 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN32990%27 HTTP/1.1" 200 None
2026-03-30 11:04:44 [auto1.es] INFO: Scrape type for EN32990: 2
2026-03-30 11:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39b8deb-b838-50f7-8c8f-3782151c202f with identifier: EN32990
2026-03-30 11:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39b8deb-b838-50f7-8c8f-3782151c202f with scrape type 2
2026-03-30 11:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e39b8deb-b838-50f7-8c8f-3782151c202f with scrape type 2
2026-03-30 11:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e39b8deb-b838-50f7-8c8f-3782151c202f, identifier: EN32990
2026-03-30 11:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e39b8deb-b838-50f7-8c8f-3782151c202f with identifier: EN32990
2026-03-30 11:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e39b8deb-b838-50f7-8c8f-3782151c202f with identifier: EN32990
2026-03-30 11:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e39b8deb-b838-50f7-8c8f-3782151c202f with identifier: EN32990 to the API
2026-03-30 11:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 106,
 'expiration_date': '2026-03-31T15:51:05Z',
 'fuel_type': 'petrol',
 'id': 'e39b8deb-b838-50f7-8c8f-3782151c202f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN32990',
 'listing': 'auction',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 38747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2023}
2026-03-30 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN32990%27 HTTP/1.1" 200 None
2026-03-30 11:04:45 [auto1.es] INFO: Saving data for EN32990: {'auction_closing_time': 1774972265.0, 'created_time': 1773147955.743761, 'last_price_update_time': 1774868685.413093}
2026-03-30 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EN32990') HTTP/1.1" 204 0
2026-03-30 11:04:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.663(s), this was the 1st time calling it.
2026-03-30 11:04:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.38229525553819 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:04:45 [auto1.es] INFO: Found listing with ID: YJ05760
2026-03-30 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ05760%27 HTTP/1.1" 200 None
2026-03-30 11:04:45 [auto1.es] INFO: Scrape type for YJ05760: 2
2026-03-30 11:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with identifier: YJ05760
2026-03-30 11:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with scrape type 2
2026-03-30 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with scrape type 2
2026-03-30 11:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346, identifier: YJ05760
2026-03-30 11:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with identifier: YJ05760
2026-03-30 11:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with identifier: YJ05760
2026-03-30 11:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with identifier: YJ05760 to the API
2026-03-30 11:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:36:08Z',
 'fuel_type': 'hybrid',
 'id': 'c29e2a4f-fe6a-54d0-80f4-1b8337ad7346',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ05760',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 35911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-01',
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x2 Rivoli',
 'transmission': 'automatic',
 'trim': '4x2 Rivoli',
 'year': 2023}
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ05760%27 HTTP/1.1" 200 None
2026-03-30 11:04:46 [auto1.es] INFO: Saving data for YJ05760: {'auction_closing_time': 1774971368.0, 'created_time': 1773131761.754467, 'last_price_update_time': 1774868686.140817}
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ05760') HTTP/1.1" 204 0
2026-03-30 11:04:46 [auto1.es] INFO: Found listing with ID: JF13229
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF13229%27 HTTP/1.1" 200 None
2026-03-30 11:04:46 [auto1.es] INFO: Scrape type for JF13229: 2
2026-03-30 11:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d35e378c-99db-5a95-83d3-fdc7b19e4eb7 with identifier: JF13229
2026-03-30 11:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d35e378c-99db-5a95-83d3-fdc7b19e4eb7 with scrape type 2
2026-03-30 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d35e378c-99db-5a95-83d3-fdc7b19e4eb7 with scrape type 2
2026-03-30 11:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d35e378c-99db-5a95-83d3-fdc7b19e4eb7, identifier: JF13229
2026-03-30 11:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d35e378c-99db-5a95-83d3-fdc7b19e4eb7 with identifier: JF13229
2026-03-30 11:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d35e378c-99db-5a95-83d3-fdc7b19e4eb7 with identifier: JF13229
2026-03-30 11:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d35e378c-99db-5a95-83d3-fdc7b19e4eb7 with identifier: JF13229 to the API
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-31T15:24:19Z',
 'fuel_type': 'diesel',
 'id': 'd35e378c-99db-5a95-83d3-fdc7b19e4eb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF13229',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 191068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-11',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2017}
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF13229%27 HTTP/1.1" 200 None
2026-03-30 11:04:46 [auto1.es] INFO: Saving data for JF13229: {'auction_closing_time': 1774970659.0, 'created_time': 1772753777.981426, 'last_price_update_time': 1774868686.641418}
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JF13229') HTTP/1.1" 204 0
2026-03-30 11:04:46 [auto1.es] INFO: Found listing with ID: HT92160
2026-03-30 11:04:46 [auto1.es] INFO: Found listing with ID: WR66787
2026-03-30 11:04:46 [auto1.es] INFO: Found listing with ID: SL49556
2026-03-30 11:04:46 [auto1.es] INFO: Found listing with ID: VG08708
2026-03-30 11:04:46 [auto1.es] INFO: Found listing with ID: HD72469
2026-03-30 11:04:46 [auto1.es] INFO: Found listing with ID: LH46678
2026-03-30 11:04:46 [auto1.es] INFO: Found listing with ID: FV43676
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV43676%27 HTTP/1.1" 200 None
2026-03-30 11:04:46 [auto1.es] INFO: Scrape type for FV43676: 2
2026-03-30 11:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cc42c5a-a309-547a-af55-afd6a58cec56 with identifier: FV43676
2026-03-30 11:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc42c5a-a309-547a-af55-afd6a58cec56 with scrape type 2
2026-03-30 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cc42c5a-a309-547a-af55-afd6a58cec56 with scrape type 2
2026-03-30 11:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8cc42c5a-a309-547a-af55-afd6a58cec56, identifier: FV43676
2026-03-30 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML73302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8cc42c5a-a309-547a-af55-afd6a58cec56 with identifier: FV43676
2026-03-30 11:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8cc42c5a-a309-547a-af55-afd6a58cec56 with identifier: FV43676
2026-03-30 11:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8cc42c5a-a309-547a-af55-afd6a58cec56 with identifier: FV43676 to the API
2026-03-30 11:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:09:42Z',
 'fuel_type': 'diesel',
 'id': '8cc42c5a-a309-547a-af55-afd6a58cec56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV43676',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 222656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-30',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV43676%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [auto1.es] INFO: Saving data for FV43676: {'auction_closing_time': 1774969782.0, 'created_time': 1774361161.133644, 'last_price_update_time': 1774868687.156793}
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FV43676') HTTP/1.1" 204 0
2026-03-30 11:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:47 [auto1.es] INFO: Found listing with ID: LP52549
2026-03-30 11:04:47 [auto1.es] INFO: Found listing with ID: YF71759
2026-03-30 11:04:47 [auto1.es] INFO: Found listing with ID: HH14310
2026-03-30 11:04:47 [auto1.es] INFO: Found listing with ID: GW76343
2026-03-30 11:04:47 [auto1.es] INFO: Found listing with ID: HL09237
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL09237%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [auto1.es] INFO: Scrape type for HL09237: 1
2026-03-30 11:04:47 [auto1.es] INFO: Found listing with ID: HC82421
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC82421%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [auto1.es] INFO: Scrape type for HC82421: 1
2026-03-30 11:04:47 [auto1.es] INFO: Found listing with ID: AC34566
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC34566%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [auto1.es] INFO: Scrape type for AC34566: 2
2026-03-30 11:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c40649-b882-5e0a-b86e-584481154cfe with identifier: AC34566
2026-03-30 11:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c40649-b882-5e0a-b86e-584481154cfe with scrape type 2
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3c40649-b882-5e0a-b86e-584481154cfe with scrape type 2
2026-03-30 11:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e3c40649-b882-5e0a-b86e-584481154cfe, identifier: AC34566
2026-03-30 11:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e3c40649-b882-5e0a-b86e-584481154cfe with identifier: AC34566
2026-03-30 11:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e3c40649-b882-5e0a-b86e-584481154cfe with identifier: AC34566
2026-03-30 11:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e3c40649-b882-5e0a-b86e-584481154cfe with identifier: AC34566 to the API
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:29:11Z',
 'fuel_type': 'diesel',
 'id': 'e3c40649-b882-5e0a-b86e-584481154cfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC34566',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 30264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-18',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 114 CDI kompakt',
 'transmission': 'automatic',
 'trim': 'kompakt',
 'year': 2021}
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC34566%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [auto1.es] INFO: Saving data for AC34566: {'auction_closing_time': 1774970951.0, 'created_time': 1773131094.931149, 'last_price_update_time': 1774868687.809698}
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AC34566') HTTP/1.1" 204 0
2026-03-30 11:04:47 [auto1.es] INFO: Found listing with ID: VX61508
2026-03-30 11:04:47 [auto1.es] INFO: Found listing with ID: GV99509
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV99509%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [auto1.es] INFO: Scrape type for GV99509: 2
2026-03-30 11:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497a8f2a-2587-51da-8e99-072b3983aed3 with identifier: GV99509
2026-03-30 11:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497a8f2a-2587-51da-8e99-072b3983aed3 with scrape type 2
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 497a8f2a-2587-51da-8e99-072b3983aed3 with scrape type 2
2026-03-30 11:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 497a8f2a-2587-51da-8e99-072b3983aed3, identifier: GV99509
2026-03-30 11:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 497a8f2a-2587-51da-8e99-072b3983aed3 with identifier: GV99509
2026-03-30 11:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 497a8f2a-2587-51da-8e99-072b3983aed3 with identifier: GV99509
2026-03-30 11:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 497a8f2a-2587-51da-8e99-072b3983aed3 with identifier: GV99509 to the API
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:47:15Z',
 'fuel_type': 'diesel',
 'id': '497a8f2a-2587-51da-8e99-072b3983aed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV99509',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 79065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-24',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2016}
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV99509%27 HTTP/1.1" 200 None
2026-03-30 11:04:48 [auto1.es] INFO: Saving data for GV99509: {'auction_closing_time': 1774972035.0, 'created_time': 1773691453.554018, 'last_price_update_time': 1774868688.296146}
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GV99509') HTTP/1.1" 204 0
2026-03-30 11:04:48 [auto1.es] INFO: Found listing with ID: SV63508
2026-03-30 11:04:48 [auto1.es] INFO: Found listing with ID: UT64547
2026-03-30 11:04:48 [auto1.es] INFO: Found listing with ID: JF84968
2026-03-30 11:04:48 [auto1.es] INFO: Found listing with ID: HK56314
2026-03-30 11:04:48 [auto1.es] INFO: Found listing with ID: XR63585
2026-03-30 11:04:48 [auto1.es] INFO: Found listing with ID: SY68664
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY68664%27 HTTP/1.1" 200 None
2026-03-30 11:04:48 [auto1.es] INFO: Scrape type for SY68664: 1
2026-03-30 11:04:48 [auto1.es] INFO: Found listing with ID: DX71922
2026-03-30 11:04:48 [auto1.es] INFO: Found listing with ID: EE39278
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW45147> (referer: https://www.auto1.com/v1/car-details-view/MW45147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab99e284-12ad-543a-b0f7-d677e3e90b57 with identifier: MW45147
2026-03-30 11:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab99e284-12ad-543a-b0f7-d677e3e90b57 with scrape type 1
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ab99e284-12ad-543a-b0f7-d677e3e90b57
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_ccef578ce798f8ba8ac51f595cc3c5ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_ccef578ce798f8ba8ac51f595cc3c5ad.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_1e91e9bcace101fa83d8e9e8391a83cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_1e91e9bcace101fa83d8e9e8391a83cf.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_ef95261155618767fb7d818f34b770a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_ef95261155618767fb7d818f34b770a7.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_4285db50fed83aff4b6cf0d9637ebfa5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_4285db50fed83aff4b6cf0d9637ebfa5.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_6854d9a383c32ae890735b53fec164bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_6854d9a383c32ae890735b53fec164bc.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_afeaac077b26eff3504e1d67727e336f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_afeaac077b26eff3504e1d67727e336f.jpg not downloaded yet
2026-03-30 11:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT58474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG26244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_afeaac077b26eff3504e1d67727e336f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66f3490>
2026-03-30 11:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_afeaac077b26eff3504e1d67727e336f.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_afeaac077b26eff3504e1d67727e336f.jpg saved to cache
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab99e284-12ad-543a-b0f7-d677e3e90b57
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW32185> (referer: https://www.auto1.com/v1/car-details-view/ZW32185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2565359a-f145-5ecc-acb9-e161afc4cfee with identifier: ZW32185
2026-03-30 11:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2565359a-f145-5ecc-acb9-e161afc4cfee with scrape type 1
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_12926274ecc23d5aa408023da363090c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_12926274ecc23d5aa408023da363090c.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_a62c0527f6352ce7f3b913f458f7830b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_a62c0527f6352ce7f3b913f458f7830b.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_fc9033a727b79e8c3188f2df9271e289.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_fc9033a727b79e8c3188f2df9271e289.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_eb23f195c9026425e45693e0fd8d308f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_eb23f195c9026425e45693e0fd8d308f.jpg not downloaded yet
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_78233f4f64a19d16675c0deb024516f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_78233f4f64a19d16675c0deb024516f9.jpg not downloaded yet
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_813175227ccd831f5b51f12ada68d1ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_813175227ccd831f5b51f12ada68d1ec.jpg not downloaded yet
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_6854d9a383c32ae890735b53fec164bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_3659c4b3dae55e23ca180a05411221ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_3659c4b3dae55e23ca180a05411221ff.jpg not downloaded yet
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_9e6356ece1a576a3497789f3436c7b1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_9e6356ece1a576a3497789f3436c7b1e.jpg not downloaded yet
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_bf9e21e306a27859e69c1f394aab6d02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_bf9e21e306a27859e69c1f394aab6d02.jpg not downloaded yet
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_8def474c4215888f3c8dc3168fdf954d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_8def474c4215888f3c8dc3168fdf954d.jpg not downloaded yet
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6502d50>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_6854d9a383c32ae890735b53fec164bc.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_6854d9a383c32ae890735b53fec164bc.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab99e284-12ad-543a-b0f7-d677e3e90b57
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_813175227ccd831f5b51f12ada68d1ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ95411> (referer: https://www.auto1.com/v1/car-details-view/UJ95411/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fc3350>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_813175227ccd831f5b51f12ada68d1ec.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_813175227ccd831f5b51f12ada68d1ec.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f with identifier: UJ95411
2026-03-30 11:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f with scrape type 1
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_fd27dc10eecc4e09d52603f2414e0b78.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_fd27dc10eecc4e09d52603f2414e0b78.jpg not downloaded yet
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_78fff80701f29d00ff0afafa6a5d66da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_78fff80701f29d00ff0afafa6a5d66da.jpg not downloaded yet
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_d55dad47a4392f604d145f5056554c03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_d55dad47a4392f604d145f5056554c03.jpg not downloaded yet
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_105d859f92b0cb09198e33313ca3e34a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_105d859f92b0cb09198e33313ca3e34a.jpg not downloaded yet
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_bf9e21e306a27859e69c1f394aab6d02.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_a873e4f2efbed8e9c1d30983ccd3f186.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_a873e4f2efbed8e9c1d30983ccd3f186.jpg not downloaded yet
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_98435534a8ed34ccedf75a15784b1f5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_98435534a8ed34ccedf75a15784b1f5c.jpg not downloaded yet
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_105d859f92b0cb09198e33313ca3e34a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_8def474c4215888f3c8dc3168fdf954d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6681ed0>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_bf9e21e306a27859e69c1f394aab6d02.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_bf9e21e306a27859e69c1f394aab6d02.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_98435534a8ed34ccedf75a15784b1f5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_a873e4f2efbed8e9c1d30983ccd3f186.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65564d0>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_105d859f92b0cb09198e33313ca3e34a.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_105d859f92b0cb09198e33313ca3e34a.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_d55dad47a4392f604d145f5056554c03.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_78fff80701f29d00ff0afafa6a5d66da.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc1ece90>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_8def474c4215888f3c8dc3168fdf954d.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_8def474c4215888f3c8dc3168fdf954d.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c2190>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_98435534a8ed34ccedf75a15784b1f5c.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_98435534a8ed34ccedf75a15784b1f5c.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66cbc10>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_a873e4f2efbed8e9c1d30983ccd3f186.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_a873e4f2efbed8e9c1d30983ccd3f186.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_fd27dc10eecc4e09d52603f2414e0b78.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c8f90>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_d55dad47a4392f604d145f5056554c03.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_d55dad47a4392f604d145f5056554c03.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662d7d0>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_78fff80701f29d00ff0afafa6a5d66da.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_78fff80701f29d00ff0afafa6a5d66da.jpg saved to cache
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f
2026-03-30 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_9e6356ece1a576a3497789f3436c7b1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD80422> (referer: https://www.auto1.com/v1/car-details-view/ZD80422/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6473010>
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F57%252F6957e81af59c3fa9f38202b0a06ce0eb%252Fpa%252FUJ95411_fd27dc10eecc4e09d52603f2414e0b78.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_fd27dc10eecc4e09d52603f2414e0b78.jpg saved to cache
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f
2026-03-30 11:04:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f, skipping ID generation
2026-03-30 11:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f with scrape type 1
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f sending to next pipeline
2026-03-30 11:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f, identifier: UJ95411
2026-03-30 11:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f with identifier: UJ95411
2026-03-30 11:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f with identifier: UJ95411
2026-03-30 11:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f with identifier: UJ95411 to the API
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_fd27dc10eecc4e09d52603f2414e0b78.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:36:43Z',
 'fuel_type': 'diesel',
 'id': 'e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ95411',
 'listing': 'auction',
 'location': 'ES, Puerto de Santa María',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 134533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_fd27dc10eecc4e09d52603f2414e0b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_78fff80701f29d00ff0afafa6a5d66da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_d55dad47a4392f604d145f5056554c03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_105d859f92b0cb09198e33313ca3e34a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_a873e4f2efbed8e9c1d30983ccd3f186.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f/e4d5cdb1-183d-5d5d-85b5-ea60f1c8072f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/57/6957e81af59c3fa9f38202b0a06ce0eb/pa/UJ95411_98435534a8ed34ccedf75a15784b1f5c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2008}
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ95411%27 HTTP/1.1" 200 None
2026-03-30 11:04:54 [auto1.es] INFO: Saving data for UJ95411: {'created_time': 1774868694.740147, 'last_price_update_time': 1774868694.740157, 'auction_closing_time': 1774971403.0}
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UJ95411') HTTP/1.1" 204 0
2026-03-30 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_3659c4b3dae55e23ca180a05411221ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB22846> (referer: https://www.auto1.com/v1/car-details-view/JB22846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb665ab90>
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_9e6356ece1a576a3497789f3436c7b1e.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_9e6356ece1a576a3497789f3436c7b1e.jpg saved to cache
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67cb2db1-3da6-59ab-bb39-f8b02861c51e with identifier: ZD80422
2026-03-30 11:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67cb2db1-3da6-59ab-bb39-f8b02861c51e with scrape type 1
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 67cb2db1-3da6-59ab-bb39-f8b02861c51e
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F69%252F4769090e9c43f418b1d4aec0c1dd372d%252Fpa%252FZD80422_3d55f057053c3498b8da3c0140f27217.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_3d55f057053c3498b8da3c0140f27217.jpg already downloaded
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F69%252F4769090e9c43f418b1d4aec0c1dd372d%252Fpa%252FZD80422_7d4541d47c6e1d92de1ff91f3ebc35e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_7d4541d47c6e1d92de1ff91f3ebc35e5.jpg already downloaded
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F69%252F4769090e9c43f418b1d4aec0c1dd372d%252Fpa%252FZD80422_0c001e381da7295b952233578d378f89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_0c001e381da7295b952233578d378f89.jpg already downloaded
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F69%252F4769090e9c43f418b1d4aec0c1dd372d%252Fpa%252FZD80422_d423de9c88f0db5358d82b2069b335d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_d423de9c88f0db5358d82b2069b335d6.jpg already downloaded
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F69%252F4769090e9c43f418b1d4aec0c1dd372d%252Fpa%252FZD80422_b62488b45d80febe03cc8cc917ada07b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_b62488b45d80febe03cc8cc917ada07b.jpg already downloaded
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F69%252F4769090e9c43f418b1d4aec0c1dd372d%252Fpa%252FZD80422_a2ba67238a662d3ea90653a8681913ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_a2ba67238a662d3ea90653a8681913ca.jpg already downloaded
2026-03-30 11:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 67cb2db1-3da6-59ab-bb39-f8b02861c51e, identifier: ZD80422
2026-03-30 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_78233f4f64a19d16675c0deb024516f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 67cb2db1-3da6-59ab-bb39-f8b02861c51e with identifier: ZD80422
2026-03-30 11:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 67cb2db1-3da6-59ab-bb39-f8b02861c51e with identifier: ZD80422
2026-03-30 11:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 67cb2db1-3da6-59ab-bb39-f8b02861c51e with identifier: ZD80422 to the API
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD80422>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:03:43Z',
 'fuel_type': 'petrol',
 'id': '67cb2db1-3da6-59ab-bb39-f8b02861c51e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD80422',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 190415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_3d55f057053c3498b8da3c0140f27217.jpg',
                'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_7d4541d47c6e1d92de1ff91f3ebc35e5.jpg',
                'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_0c001e381da7295b952233578d378f89.jpg',
                'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_d423de9c88f0db5358d82b2069b335d6.jpg',
                'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_b62488b45d80febe03cc8cc917ada07b.jpg',
                'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_a2ba67238a662d3ea90653a8681913ca.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cb2db1-3da6-59ab-bb39-f8b02861c51e/67cb2db1-3da6-59ab-bb39-f8b02861c51e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_3d55f057053c3498b8da3c0140f27217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cb2db1-3da6-59ab-bb39-f8b02861c51e/67cb2db1-3da6-59ab-bb39-f8b02861c51e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_7d4541d47c6e1d92de1ff91f3ebc35e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cb2db1-3da6-59ab-bb39-f8b02861c51e/67cb2db1-3da6-59ab-bb39-f8b02861c51e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_0c001e381da7295b952233578d378f89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cb2db1-3da6-59ab-bb39-f8b02861c51e/67cb2db1-3da6-59ab-bb39-f8b02861c51e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_d423de9c88f0db5358d82b2069b335d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cb2db1-3da6-59ab-bb39-f8b02861c51e/67cb2db1-3da6-59ab-bb39-f8b02861c51e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_b62488b45d80febe03cc8cc917ada07b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cb2db1-3da6-59ab-bb39-f8b02861c51e/67cb2db1-3da6-59ab-bb39-f8b02861c51e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/69/4769090e9c43f418b1d4aec0c1dd372d/pa/ZD80422_a2ba67238a662d3ea90653a8681913ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.1 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2009}
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD80422%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.es] INFO: Saving data for ZD80422: {'created_time': 1774868695.562757, 'last_price_update_time': 1774868695.56277, 'auction_closing_time': 1774969423.0}
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD80422') HTTP/1.1" 204 0
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66e6190>
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_3659c4b3dae55e23ca180a05411221ff.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_3659c4b3dae55e23ca180a05411221ff.jpg saved to cache
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a278497-9283-55a2-b51e-96b4c7709fcd with identifier: JB22846
2026-03-30 11:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a278497-9283-55a2-b51e-96b4c7709fcd with scrape type 1
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_3bf987e629e7d5040c1773bf63dbb8ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_3bf987e629e7d5040c1773bf63dbb8ba.jpg not downloaded yet
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_a4be224c78ee44daecaa8ec86d1ec498.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_a4be224c78ee44daecaa8ec86d1ec498.jpg not downloaded yet
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c3ad0>
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_78233f4f64a19d16675c0deb024516f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_78233f4f64a19d16675c0deb024516f9.jpg saved to cache
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_fc9033a727b79e8c3188f2df9271e289.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_a120bffdd695ca8713e284112feb6c9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_a120bffdd695ca8713e284112feb6c9f.jpg not downloaded yet
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_b100bf62c399fa138eccef9a245c1afb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_b100bf62c399fa138eccef9a245c1afb.jpg not downloaded yet
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_c0473ab82a0e53b7de0a8f6b12171c68.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_c0473ab82a0e53b7de0a8f6b12171c68.jpg not downloaded yet
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_24d8ba7f709e3f7e68204b446d9a9a12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_24d8ba7f709e3f7e68204b446d9a9a12.jpg not downloaded yet
2026-03-30 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_a4be224c78ee44daecaa8ec86d1ec498.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_9bb6ff9239d4fedeb62596f066a0cb75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_9bb6ff9239d4fedeb62596f066a0cb75.jpg not downloaded yet
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_9e6f0cbe56099954f55fd17ecd0f866e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_9e6f0cbe56099954f55fd17ecd0f866e.jpg not downloaded yet
2026-03-30 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_a62c0527f6352ce7f3b913f458f7830b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_791b954158dc8d1c786fdf547668e1b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_791b954158dc8d1c786fdf547668e1b6.jpg not downloaded yet
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb650e150>
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_fc9033a727b79e8c3188f2df9271e289.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_fc9033a727b79e8c3188f2df9271e289.jpg saved to cache
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_6329422f22c3e8f2e203a2667721845c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_6329422f22c3e8f2e203a2667721845c.jpg not downloaded yet
2026-03-30 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_12926274ecc23d5aa408023da363090c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6476410>
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_a4be224c78ee44daecaa8ec86d1ec498.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_a4be224c78ee44daecaa8ec86d1ec498.jpg saved to cache
2026-03-30 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc217410>
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_a62c0527f6352ce7f3b913f458f7830b.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_a62c0527f6352ce7f3b913f458f7830b.jpg saved to cache
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_c0473ab82a0e53b7de0a8f6b12171c68.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_eb23f195c9026425e45693e0fd8d308f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f5da50>
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_12926274ecc23d5aa408023da363090c.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_12926274ecc23d5aa408023da363090c.jpg saved to cache
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_9e6f0cbe56099954f55fd17ecd0f866e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c2a90>
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_c0473ab82a0e53b7de0a8f6b12171c68.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_c0473ab82a0e53b7de0a8f6b12171c68.jpg saved to cache
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c0ed0>
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F9e%252F369eaf903a47daed33560156008c8fa3%252Fpa%252FZW32185_eb23f195c9026425e45693e0fd8d308f.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_eb23f195c9026425e45693e0fd8d308f.jpg saved to cache
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2565359a-f145-5ecc-acb9-e161afc4cfee
2026-03-30 11:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2565359a-f145-5ecc-acb9-e161afc4cfee, skipping ID generation
2026-03-30 11:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2565359a-f145-5ecc-acb9-e161afc4cfee with scrape type 1
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2565359a-f145-5ecc-acb9-e161afc4cfee sending to next pipeline
2026-03-30 11:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2565359a-f145-5ecc-acb9-e161afc4cfee, identifier: ZW32185
2026-03-30 11:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2565359a-f145-5ecc-acb9-e161afc4cfee with identifier: ZW32185
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 11:04:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2565359a-f145-5ecc-acb9-e161afc4cfee with identifier: ZW32185
2026-03-30 11:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2565359a-f145-5ecc-acb9-e161afc4cfee with identifier: ZW32185 to the API
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_eb23f195c9026425e45693e0fd8d308f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:33:37Z',
 'fuel_type': 'diesel',
 'id': '2565359a-f145-5ecc-acb9-e161afc4cfee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW32185',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 131163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_12926274ecc23d5aa408023da363090c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_a62c0527f6352ce7f3b913f458f7830b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_fc9033a727b79e8c3188f2df9271e289.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_eb23f195c9026425e45693e0fd8d308f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_78233f4f64a19d16675c0deb024516f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_813175227ccd831f5b51f12ada68d1ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_3659c4b3dae55e23ca180a05411221ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_9e6356ece1a576a3497789f3436c7b1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_bf9e21e306a27859e69c1f394aab6d02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2565359a-f145-5ecc-acb9-e161afc4cfee/2565359a-f145-5ecc-acb9-e161afc4cfee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/9e/369eaf903a47daed33560156008c8fa3/pa/ZW32185_8def474c4215888f3c8dc3168fdf954d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Altea 2.0 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2011}
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW32185%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.es] INFO: Saving data for ZW32185: {'created_time': 1774868696.883426, 'last_price_update_time': 1774868696.883436, 'auction_closing_time': 1774971217.0}
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZW32185') HTTP/1.1" 204 0
2026-03-30 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_6329422f22c3e8f2e203a2667721845c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_24d8ba7f709e3f7e68204b446d9a9a12.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_791b954158dc8d1c786fdf547668e1b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_9bb6ff9239d4fedeb62596f066a0cb75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU48327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65cac50>
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_9e6f0cbe56099954f55fd17ecd0f866e.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_9e6f0cbe56099954f55fd17ecd0f866e.jpg saved to cache
2026-03-30 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6680510>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_6329422f22c3e8f2e203a2667721845c.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_6329422f22c3e8f2e203a2667721845c.jpg saved to cache
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_3bf987e629e7d5040c1773bf63dbb8ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_a120bffdd695ca8713e284112feb6c9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_b100bf62c399fa138eccef9a245c1afb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6560310>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_24d8ba7f709e3f7e68204b446d9a9a12.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_24d8ba7f709e3f7e68204b446d9a9a12.jpg saved to cache
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6504650>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_791b954158dc8d1c786fdf547668e1b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_791b954158dc8d1c786fdf547668e1b6.jpg saved to cache
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd2dd290>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_9bb6ff9239d4fedeb62596f066a0cb75.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_9bb6ff9239d4fedeb62596f066a0cb75.jpg saved to cache
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_4285db50fed83aff4b6cf0d9637ebfa5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_ef95261155618767fb7d818f34b770a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc190510>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_3bf987e629e7d5040c1773bf63dbb8ba.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_3bf987e629e7d5040c1773bf63dbb8ba.jpg saved to cache
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb661b550>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_a120bffdd695ca8713e284112feb6c9f.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_a120bffdd695ca8713e284112feb6c9f.jpg saved to cache
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c1590>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fe7%252Fb8e73f09944e482a6b3c3ba0287d8009%252Fpa%252FJB22846_b100bf62c399fa138eccef9a245c1afb.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_b100bf62c399fa138eccef9a245c1afb.jpg saved to cache
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a278497-9283-55a2-b51e-96b4c7709fcd
2026-03-30 11:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a278497-9283-55a2-b51e-96b4c7709fcd, skipping ID generation
2026-03-30 11:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a278497-9283-55a2-b51e-96b4c7709fcd with scrape type 1
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a278497-9283-55a2-b51e-96b4c7709fcd sending to next pipeline
2026-03-30 11:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a278497-9283-55a2-b51e-96b4c7709fcd, identifier: JB22846
2026-03-30 11:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a278497-9283-55a2-b51e-96b4c7709fcd with identifier: JB22846
2026-03-30 11:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a278497-9283-55a2-b51e-96b4c7709fcd with identifier: JB22846
2026-03-30 11:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a278497-9283-55a2-b51e-96b4c7709fcd with identifier: JB22846 to the API
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_b100bf62c399fa138eccef9a245c1afb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:48:54Z',
 'fuel_type': 'diesel',
 'id': '5a278497-9283-55a2-b51e-96b4c7709fcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB22846',
 'listing': 'auction',
 'location': 'ES, Alcobendas',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 69412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_3bf987e629e7d5040c1773bf63dbb8ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_a4be224c78ee44daecaa8ec86d1ec498.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_a120bffdd695ca8713e284112feb6c9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_b100bf62c399fa138eccef9a245c1afb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_c0473ab82a0e53b7de0a8f6b12171c68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_24d8ba7f709e3f7e68204b446d9a9a12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_9bb6ff9239d4fedeb62596f066a0cb75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_9e6f0cbe56099954f55fd17ecd0f866e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_791b954158dc8d1c786fdf547668e1b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a278497-9283-55a2-b51e-96b4c7709fcd/5a278497-9283-55a2-b51e-96b4c7709fcd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/e7/b8e73f09944e482a6b3c3ba0287d8009/pa/JB22846_6329422f22c3e8f2e203a2667721845c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Verso 2.0 D-4D Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB22846%27 HTTP/1.1" 200 None
2026-03-30 11:04:57 [auto1.es] INFO: Saving data for JB22846: {'created_time': 1774868697.85683, 'last_price_update_time': 1774868697.85684, 'auction_closing_time': 1774972134.0}
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JB22846') HTTP/1.1" 204 0
2026-03-30 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_ccef578ce798f8ba8ac51f595cc3c5ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_1e91e9bcace101fa83d8e9e8391a83cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f2b9d0>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_4285db50fed83aff4b6cf0d9637ebfa5.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_4285db50fed83aff4b6cf0d9637ebfa5.jpg saved to cache
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab99e284-12ad-543a-b0f7-d677e3e90b57
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66bfed0>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_ef95261155618767fb7d818f34b770a7.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_ef95261155618767fb7d818f34b770a7.jpg saved to cache
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab99e284-12ad-543a-b0f7-d677e3e90b57
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c7d50>
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_ccef578ce798f8ba8ac51f595cc3c5ad.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_ccef578ce798f8ba8ac51f595cc3c5ad.jpg saved to cache
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab99e284-12ad-543a-b0f7-d677e3e90b57
2026-03-30 11:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c1190>
2026-03-30 11:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1f%252Fe31fd15a9073504c10a1fc84c274ef19%252Fpa%252FMW45147_1e91e9bcace101fa83d8e9e8391a83cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_1e91e9bcace101fa83d8e9e8391a83cf.jpg saved to cache
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab99e284-12ad-543a-b0f7-d677e3e90b57
2026-03-30 11:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab99e284-12ad-543a-b0f7-d677e3e90b57, skipping ID generation
2026-03-30 11:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab99e284-12ad-543a-b0f7-d677e3e90b57 with scrape type 1
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab99e284-12ad-543a-b0f7-d677e3e90b57 sending to next pipeline
2026-03-30 11:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ab99e284-12ad-543a-b0f7-d677e3e90b57, identifier: MW45147
2026-03-30 11:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ab99e284-12ad-543a-b0f7-d677e3e90b57 with identifier: MW45147
2026-03-30 11:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ab99e284-12ad-543a-b0f7-d677e3e90b57 with identifier: MW45147
2026-03-30 11:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ab99e284-12ad-543a-b0f7-d677e3e90b57 with identifier: MW45147 to the API
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_1e91e9bcace101fa83d8e9e8391a83cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:49:31Z',
 'fuel_type': 'diesel',
 'id': 'ab99e284-12ad-543a-b0f7-d677e3e90b57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW45147',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 208073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_ccef578ce798f8ba8ac51f595cc3c5ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_1e91e9bcace101fa83d8e9e8391a83cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_ef95261155618767fb7d818f34b770a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_4285db50fed83aff4b6cf0d9637ebfa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_6854d9a383c32ae890735b53fec164bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab99e284-12ad-543a-b0f7-d677e3e90b57/ab99e284-12ad-543a-b0f7-d677e3e90b57_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1f/e31fd15a9073504c10a1fc84c274ef19/pa/MW45147_afeaac077b26eff3504e1d67727e336f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW45147%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.es] INFO: Saving data for MW45147: {'created_time': 1774868698.492705, 'last_price_update_time': 1774868698.492716, 'auction_closing_time': 1774972171.0}
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MW45147') HTTP/1.1" 204 0
2026-03-30 11:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:58 [auto1.es] INFO: Channel: 24h | Page: 6 | totalHits: 2194 | hits on page: 40
2026-03-30 11:04:58 [auto1.es] INFO: Found listing with ID: EE39278
2026-03-30 11:04:58 [auto1.es] INFO: Found listing with ID: AT55590
2026-03-30 11:04:58 [auto1.es] INFO: Found listing with ID: WA42706
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA42706%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.es] INFO: Scrape type for WA42706: 2
2026-03-30 11:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e19e62-450f-5eb2-837e-18d28272f1f4 with identifier: WA42706
2026-03-30 11:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e19e62-450f-5eb2-837e-18d28272f1f4 with scrape type 2
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e19e62-450f-5eb2-837e-18d28272f1f4 with scrape type 2
2026-03-30 11:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40e19e62-450f-5eb2-837e-18d28272f1f4, identifier: WA42706
2026-03-30 11:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40e19e62-450f-5eb2-837e-18d28272f1f4 with identifier: WA42706
2026-03-30 11:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40e19e62-450f-5eb2-837e-18d28272f1f4 with identifier: WA42706
2026-03-30 11:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40e19e62-450f-5eb2-837e-18d28272f1f4 with identifier: WA42706 to the API
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:08:53Z',
 'fuel_type': 'diesel',
 'id': '40e19e62-450f-5eb2-837e-18d28272f1f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA42706',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 144183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-18',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2017}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA42706%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.es] INFO: Saving data for WA42706: {'auction_closing_time': 1774969733.0, 'created_time': 1773131103.327179, 'last_price_update_time': 1774868699.196507}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA42706') HTTP/1.1" 204 0
2026-03-30 11:04:59 [auto1.es] INFO: Found listing with ID: UJ02953
2026-03-30 11:04:59 [auto1.es] INFO: Found listing with ID: ZZ48834
2026-03-30 11:04:59 [auto1.es] INFO: Found listing with ID: XH14423
2026-03-30 11:04:59 [auto1.es] INFO: Found listing with ID: XW97577
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW97577%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.es] INFO: Scrape type for XW97577: 2
2026-03-30 11:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with identifier: XW97577
2026-03-30 11:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with scrape type 2
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with scrape type 2
2026-03-30 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b90ae97-55a7-5447-98ec-1442e2ab4d48, identifier: XW97577
2026-03-30 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with identifier: XW97577
2026-03-30 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with identifier: XW97577
2026-03-30 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with identifier: XW97577 to the API
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:42:59Z',
 'fuel_type': 'petrol',
 'id': '6b90ae97-55a7-5447-98ec-1442e2ab4d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW97577',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 57719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B3 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2023}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW97577%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.es] INFO: Saving data for XW97577: {'auction_closing_time': 1774971779.0, 'created_time': 1773131946.785816, 'last_price_update_time': 1774868699.665476}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XW97577') HTTP/1.1" 204 0
2026-03-30 11:04:59 [auto1.es] INFO: Found listing with ID: LX18680
2026-03-30 11:04:59 [auto1.es] INFO: Found listing with ID: EG85848
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG85848%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.es] INFO: Scrape type for EG85848: 2
2026-03-30 11:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with identifier: EG85848
2026-03-30 11:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with scrape type 2
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with scrape type 2
2026-03-30 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2, identifier: EG85848
2026-03-30 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with identifier: EG85848
2026-03-30 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with identifier: EG85848
2026-03-30 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with identifier: EG85848 to the API
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:27:46Z',
 'fuel_type': 'petrol',
 'id': 'b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG85848',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 41317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-29',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2022}
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG85848%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.es] INFO: Saving data for EG85848: {'auction_closing_time': 1774970866.0, 'created_time': 1773132149.535303, 'last_price_update_time': 1774868700.206741}
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG85848') HTTP/1.1" 204 0
2026-03-30 11:05:00 [auto1.es] INFO: Found listing with ID: WA83651
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA83651%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.es] INFO: Scrape type for WA83651: 2
2026-03-30 11:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b6ba251-62f6-5df4-bafc-69f744a392f2 with identifier: WA83651
2026-03-30 11:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b6ba251-62f6-5df4-bafc-69f744a392f2 with scrape type 2
2026-03-30 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b6ba251-62f6-5df4-bafc-69f744a392f2 with scrape type 2
2026-03-30 11:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b6ba251-62f6-5df4-bafc-69f744a392f2, identifier: WA83651
2026-03-30 11:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b6ba251-62f6-5df4-bafc-69f744a392f2 with identifier: WA83651
2026-03-30 11:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b6ba251-62f6-5df4-bafc-69f744a392f2 with identifier: WA83651
2026-03-30 11:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0b6ba251-62f6-5df4-bafc-69f744a392f2 with identifier: WA83651 to the API
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:33:38Z',
 'fuel_type': 'diesel',
 'id': '0b6ba251-62f6-5df4-bafc-69f744a392f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA83651',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 216267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-30',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2007}
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA83651%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.es] INFO: Saving data for WA83651: {'auction_closing_time': 1774971218.0, 'created_time': 1773659050.547262, 'last_price_update_time': 1774868700.684598}
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA83651') HTTP/1.1" 204 0
2026-03-30 11:05:00 [auto1.es] INFO: Found listing with ID: WL52368
2026-03-30 11:05:00 [auto1.es] INFO: Found listing with ID: BX88029
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX88029%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.es] INFO: Scrape type for BX88029: 2
2026-03-30 11:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 853e10e5-5ea7-5e05-9eaf-3277eeebfc30 with identifier: BX88029
2026-03-30 11:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 853e10e5-5ea7-5e05-9eaf-3277eeebfc30 with scrape type 2
2026-03-30 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 853e10e5-5ea7-5e05-9eaf-3277eeebfc30 with scrape type 2
2026-03-30 11:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 853e10e5-5ea7-5e05-9eaf-3277eeebfc30, identifier: BX88029
2026-03-30 11:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 853e10e5-5ea7-5e05-9eaf-3277eeebfc30 with identifier: BX88029
2026-03-30 11:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 853e10e5-5ea7-5e05-9eaf-3277eeebfc30 with identifier: BX88029
2026-03-30 11:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 853e10e5-5ea7-5e05-9eaf-3277eeebfc30 with identifier: BX88029 to the API
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:29:44Z',
 'fuel_type': 'diesel',
 'id': '853e10e5-5ea7-5e05-9eaf-3277eeebfc30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX88029',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 133267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX88029%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.es] INFO: Saving data for BX88029: {'auction_closing_time': 1774970984.0, 'created_time': 1772753029.327613, 'last_price_update_time': 1774868701.345601}
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX88029') HTTP/1.1" 204 0
2026-03-30 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY14262> (referer: https://www.auto1.com/v1/car-details-view/UY14262/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:01 [auto1.es] INFO: Found listing with ID: UZ66881
2026-03-30 11:05:01 [auto1.es] INFO: Found listing with ID: BL63813
2026-03-30 11:05:01 [auto1.es] INFO: Found listing with ID: TU33340
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU33340%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.es] INFO: Scrape type for TU33340: 2
2026-03-30 11:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d457ec8-ef2e-5c53-b840-15fffb165825 with identifier: TU33340
2026-03-30 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d457ec8-ef2e-5c53-b840-15fffb165825 with scrape type 2
2026-03-30 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d457ec8-ef2e-5c53-b840-15fffb165825 with scrape type 2
2026-03-30 11:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d457ec8-ef2e-5c53-b840-15fffb165825, identifier: TU33340
2026-03-30 11:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d457ec8-ef2e-5c53-b840-15fffb165825 with identifier: TU33340
2026-03-30 11:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d457ec8-ef2e-5c53-b840-15fffb165825 with identifier: TU33340
2026-03-30 11:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d457ec8-ef2e-5c53-b840-15fffb165825 with identifier: TU33340 to the API
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:45:11Z',
 'fuel_type': 'hybrid',
 'id': '6d457ec8-ef2e-5c53-b840-15fffb165825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU33340',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 11913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-26',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.6 E-Tense Hybrid Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2024}
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU33340%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.es] INFO: Saving data for TU33340: {'auction_closing_time': 1774971911.0, 'created_time': 1773131109.433281, 'last_price_update_time': 1774868702.269114}
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TU33340') HTTP/1.1" 204 0
2026-03-30 11:05:02 [auto1.es] INFO: Found listing with ID: DV32133
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV32133%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.es] INFO: Scrape type for DV32133: 2
2026-03-30 11:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9d454ce-1278-5b5b-8f3f-53a442142b7d with identifier: DV32133
2026-03-30 11:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9d454ce-1278-5b5b-8f3f-53a442142b7d with scrape type 2
2026-03-30 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9d454ce-1278-5b5b-8f3f-53a442142b7d with scrape type 2
2026-03-30 11:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9d454ce-1278-5b5b-8f3f-53a442142b7d, identifier: DV32133
2026-03-30 11:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9d454ce-1278-5b5b-8f3f-53a442142b7d with identifier: DV32133
2026-03-30 11:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9d454ce-1278-5b5b-8f3f-53a442142b7d with identifier: DV32133
2026-03-30 11:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9d454ce-1278-5b5b-8f3f-53a442142b7d with identifier: DV32133 to the API
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:42:23Z',
 'fuel_type': 'petrol',
 'id': 'a9d454ce-1278-5b5b-8f3f-53a442142b7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV32133',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 126561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV32133%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.es] INFO: Saving data for DV32133: {'auction_closing_time': 1774971743.0, 'created_time': 1773131925.882401, 'last_price_update_time': 1774868703.335525}
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DV32133') HTTP/1.1" 204 0
2026-03-30 11:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90e33010-cea2-51f3-a725-9404191b5ae4 with identifier: UY14262
2026-03-30 11:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90e33010-cea2-51f3-a725-9404191b5ae4 with scrape type 1
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_02dde017335a9602d8a34a2f6ed4df23.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_02dde017335a9602d8a34a2f6ed4df23.jpg not downloaded yet
2026-03-30 11:05:03 [auto1.es] INFO: Found listing with ID: ZE12212
2026-03-30 11:05:03 [auto1.es] INFO: Found listing with ID: RX15442
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX15442%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.es] INFO: Scrape type for RX15442: 2
2026-03-30 11:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7502f183-80ca-5864-bfe3-132566d103db with identifier: RX15442
2026-03-30 11:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7502f183-80ca-5864-bfe3-132566d103db with scrape type 2
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7502f183-80ca-5864-bfe3-132566d103db with scrape type 2
2026-03-30 11:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7502f183-80ca-5864-bfe3-132566d103db, identifier: RX15442
2026-03-30 11:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7502f183-80ca-5864-bfe3-132566d103db with identifier: RX15442
2026-03-30 11:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7502f183-80ca-5864-bfe3-132566d103db with identifier: RX15442
2026-03-30 11:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7502f183-80ca-5864-bfe3-132566d103db with identifier: RX15442 to the API
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:58:37Z',
 'fuel_type': 'petrol',
 'id': '7502f183-80ca-5864-bfe3-132566d103db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX15442',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 21186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-25',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.5 TGDI Mild-Hybrid GT-Line",
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2025}
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX15442%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.es] INFO: Saving data for RX15442: {'auction_closing_time': 1774972717.0, 'created_time': 1773131949.432402, 'last_price_update_time': 1774868704.048961}
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RX15442') HTTP/1.1" 204 0
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_9ae159c3b737a8fbc86048568707b308.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_9ae159c3b737a8fbc86048568707b308.jpg not downloaded yet
2026-03-30 11:05:04 [scrapy.extensions.logstats] INFO: Crawled 65 pages (at 15 pages/min), scraped 88 items (at 25 items/min)
2026-03-30 11:05:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:05:04 [auto1.es] INFO: Found listing with ID: ER99924
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER99924%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.es] INFO: Scrape type for ER99924: 2
2026-03-30 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3ac6418-f001-5349-b9bd-5685e2050f28 with identifier: ER99924
2026-03-30 11:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3ac6418-f001-5349-b9bd-5685e2050f28 with scrape type 2
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3ac6418-f001-5349-b9bd-5685e2050f28 with scrape type 2
2026-03-30 11:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3ac6418-f001-5349-b9bd-5685e2050f28, identifier: ER99924
2026-03-30 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS41958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3ac6418-f001-5349-b9bd-5685e2050f28 with identifier: ER99924
2026-03-30 11:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3ac6418-f001-5349-b9bd-5685e2050f28 with identifier: ER99924
2026-03-30 11:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3ac6418-f001-5349-b9bd-5685e2050f28 with identifier: ER99924 to the API
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:18:10Z',
 'fuel_type': 'petrol',
 'id': 'f3ac6418-f001-5349-b9bd-5685e2050f28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER99924',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 150847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-20',
 'seller_name': None,
 'title': 'Kia Rio 1.2 X-Tech',
 'transmission': 'manual',
 'trim': 'X-Tech',
 'year': 2015}
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER99924%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.es] INFO: Saving data for ER99924: {'auction_closing_time': 1774970290.0, 'created_time': 1773432325.565716, 'last_price_update_time': 1774868704.647471}
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ER99924') HTTP/1.1" 204 0
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_be1db5f0273f817e16612eb63cec864e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_be1db5f0273f817e16612eb63cec864e.jpg not downloaded yet
2026-03-30 11:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:04 [auto1.es] INFO: Found listing with ID: KW14097
2026-03-30 11:05:04 [auto1.es] INFO: Found listing with ID: VE04719
2026-03-30 11:05:04 [auto1.es] INFO: Found listing with ID: AJ63740
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ63740%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.es] INFO: Scrape type for AJ63740: 2
2026-03-30 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with identifier: AJ63740
2026-03-30 11:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with scrape type 2
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with scrape type 2
2026-03-30 11:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5, identifier: AJ63740
2026-03-30 11:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with identifier: AJ63740
2026-03-30 11:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with identifier: AJ63740
2026-03-30 11:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with identifier: AJ63740 to the API
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:02:28Z',
 'fuel_type': 'diesel',
 'id': '29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ63740',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 293747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ63740%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.es] INFO: Saving data for AJ63740: {'auction_closing_time': 1774969348.0, 'created_time': 1774296110.558254, 'last_price_update_time': 1774868705.299988}
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ63740') HTTP/1.1" 204 0
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_848aab99b54fa533b0f6a9678ced329c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_848aab99b54fa533b0f6a9678ced329c.jpg not downloaded yet
2026-03-30 11:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_02dde017335a9602d8a34a2f6ed4df23.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:05 [auto1.es] INFO: Found listing with ID: TM33190
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM33190%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.es] INFO: Scrape type for TM33190: 2
2026-03-30 11:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5370a796-554c-537b-b2a3-df4973af9c5e with identifier: TM33190
2026-03-30 11:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5370a796-554c-537b-b2a3-df4973af9c5e with scrape type 2
2026-03-30 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5370a796-554c-537b-b2a3-df4973af9c5e with scrape type 2
2026-03-30 11:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5370a796-554c-537b-b2a3-df4973af9c5e, identifier: TM33190
2026-03-30 11:05:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.243(s), this was the 1st time calling it.
2026-03-30 11:05:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.727323971498055 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5370a796-554c-537b-b2a3-df4973af9c5e with identifier: TM33190
2026-03-30 11:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5370a796-554c-537b-b2a3-df4973af9c5e with identifier: TM33190
2026-03-30 11:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5370a796-554c-537b-b2a3-df4973af9c5e with identifier: TM33190 to the API
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:04:14Z',
 'fuel_type': 'diesel',
 'id': '5370a796-554c-537b-b2a3-df4973af9c5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM33190',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 195996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2016}
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM33190%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.es] INFO: Saving data for TM33190: {'auction_closing_time': 1774969454.0, 'created_time': 1774469193.597268, 'last_price_update_time': 1774868705.805173}
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TM33190') HTTP/1.1" 204 0
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_c3bc2b9b2dc28015128fcecbe1776831.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c3bc2b9b2dc28015128fcecbe1776831.jpg not downloaded yet
2026-03-30 11:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_9ae159c3b737a8fbc86048568707b308.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:05 [auto1.es] INFO: Found listing with ID: TE55978
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE55978%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.es] INFO: Scrape type for TE55978: 2
2026-03-30 11:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00c15c22-6912-5a8b-9272-739f1175edd7 with identifier: TE55978
2026-03-30 11:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00c15c22-6912-5a8b-9272-739f1175edd7 with scrape type 2
2026-03-30 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00c15c22-6912-5a8b-9272-739f1175edd7 with scrape type 2
2026-03-30 11:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00c15c22-6912-5a8b-9272-739f1175edd7, identifier: TE55978
2026-03-30 11:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00c15c22-6912-5a8b-9272-739f1175edd7 with identifier: TE55978
2026-03-30 11:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00c15c22-6912-5a8b-9272-739f1175edd7 with identifier: TE55978
2026-03-30 11:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00c15c22-6912-5a8b-9272-739f1175edd7 with identifier: TE55978 to the API
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:24:02Z',
 'fuel_type': 'diesel',
 'id': '00c15c22-6912-5a8b-9272-739f1175edd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE55978',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 149738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-23',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE55978%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.es] INFO: Saving data for TE55978: {'auction_closing_time': 1774970642.0, 'created_time': 1773131942.571228, 'last_price_update_time': 1774868706.406871}
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TE55978') HTTP/1.1" 204 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_29033320862646857107c9a335d315ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_29033320862646857107c9a335d315ae.jpg not downloaded yet
2026-03-30 11:05:06 [auto1.es] INFO: Found listing with ID: SA67244
2026-03-30 11:05:06 [auto1.es] INFO: Found listing with ID: DG64903
2026-03-30 11:05:06 [auto1.es] INFO: Found listing with ID: YE59618
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE59618%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.es] INFO: Scrape type for YE59618: 2
2026-03-30 11:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2003a025-b00c-5bf6-a204-5119b3de4890 with identifier: YE59618
2026-03-30 11:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2003a025-b00c-5bf6-a204-5119b3de4890 with scrape type 2
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2003a025-b00c-5bf6-a204-5119b3de4890 with scrape type 2
2026-03-30 11:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2003a025-b00c-5bf6-a204-5119b3de4890, identifier: YE59618
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT58474> (referer: https://www.auto1.com/v1/car-details-view/FT58474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc18c250>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_02dde017335a9602d8a34a2f6ed4df23.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_02dde017335a9602d8a34a2f6ed4df23.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_be1db5f0273f817e16612eb63cec864e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2003a025-b00c-5bf6-a204-5119b3de4890 with identifier: YE59618
2026-03-30 11:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2003a025-b00c-5bf6-a204-5119b3de4890 with identifier: YE59618
2026-03-30 11:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2003a025-b00c-5bf6-a204-5119b3de4890 with identifier: YE59618 to the API
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:12:50Z',
 'fuel_type': 'diesel',
 'id': '2003a025-b00c-5bf6-a204-5119b3de4890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE59618',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 141186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi SoChic',
 'transmission': 'automatic',
 'trim': 'SoChic',
 'year': 2021}
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE59618%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.es] INFO: Saving data for YE59618: {'auction_closing_time': 1774969970.0, 'created_time': 1773131105.057342, 'last_price_update_time': 1774868706.996266}
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YE59618') HTTP/1.1" 204 0
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_7099d6af751bc2bd756c9cbe6068c044.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_7099d6af751bc2bd756c9cbe6068c044.jpg not downloaded yet
2026-03-30 11:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_848aab99b54fa533b0f6a9678ced329c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:07 [auto1.es] INFO: Found listing with ID: SN21821
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN21821%27 HTTP/1.1" 200 None
2026-03-30 11:05:07 [auto1.es] INFO: Scrape type for SN21821: 2
2026-03-30 11:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76885960-bbb7-5e3d-84a8-6c04cbfc35f7 with identifier: SN21821
2026-03-30 11:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76885960-bbb7-5e3d-84a8-6c04cbfc35f7 with scrape type 2
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76885960-bbb7-5e3d-84a8-6c04cbfc35f7 with scrape type 2
2026-03-30 11:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 76885960-bbb7-5e3d-84a8-6c04cbfc35f7, identifier: SN21821
2026-03-30 11:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbcfa5350>
2026-03-30 11:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_9ae159c3b737a8fbc86048568707b308.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_9ae159c3b737a8fbc86048568707b308.jpg saved to cache
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 76885960-bbb7-5e3d-84a8-6c04cbfc35f7 with identifier: SN21821
2026-03-30 11:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 76885960-bbb7-5e3d-84a8-6c04cbfc35f7 with identifier: SN21821
2026-03-30 11:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 76885960-bbb7-5e3d-84a8-6c04cbfc35f7 with identifier: SN21821 to the API
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:13:51Z',
 'fuel_type': 'diesel',
 'id': '76885960-bbb7-5e3d-84a8-6c04cbfc35f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN21821',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 368006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-30',
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D3 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2012}
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN21821%27 HTTP/1.1" 200 None
2026-03-30 11:05:07 [auto1.es] INFO: Saving data for SN21821: {'auction_closing_time': 1774970031.0, 'created_time': 1774015682.713161, 'last_price_update_time': 1774868707.50973}
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SN21821') HTTP/1.1" 204 0
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_c743e3b7fee1620fe642a9ea2872048a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c743e3b7fee1620fe642a9ea2872048a.jpg not downloaded yet
2026-03-30 11:05:07 [auto1.es] INFO: Found listing with ID: YP50704
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP50704%27 HTTP/1.1" 200 None
2026-03-30 11:05:07 [auto1.es] INFO: Scrape type for YP50704: 2
2026-03-30 11:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 352bd981-e786-5639-a6eb-43e1869b72ae with identifier: YP50704
2026-03-30 11:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352bd981-e786-5639-a6eb-43e1869b72ae with scrape type 2
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 352bd981-e786-5639-a6eb-43e1869b72ae with scrape type 2
2026-03-30 11:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 352bd981-e786-5639-a6eb-43e1869b72ae, identifier: YP50704
2026-03-30 11:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5202fb29-d750-5087-b345-5fd14272d8cb with identifier: FT58474
2026-03-30 11:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5202fb29-d750-5087-b345-5fd14272d8cb with scrape type 1
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_c647d821864874a2102cbd0ec7bb2150.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_c647d821864874a2102cbd0ec7bb2150.jpg not downloaded yet
2026-03-30 11:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6681c10>
2026-03-30 11:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_be1db5f0273f817e16612eb63cec864e.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_be1db5f0273f817e16612eb63cec864e.jpg saved to cache
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 352bd981-e786-5639-a6eb-43e1869b72ae with identifier: YP50704
2026-03-30 11:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 352bd981-e786-5639-a6eb-43e1869b72ae with identifier: YP50704
2026-03-30 11:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 352bd981-e786-5639-a6eb-43e1869b72ae with identifier: YP50704 to the API
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:51:30Z',
 'fuel_type': 'hybrid',
 'id': '352bd981-e786-5639-a6eb-43e1869b72ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP50704',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 19940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-17',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP50704%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.es] INFO: Saving data for YP50704: {'auction_closing_time': 1774972290.0, 'created_time': 1773132157.132613, 'last_price_update_time': 1774868708.075416}
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YP50704') HTTP/1.1" 204 0
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_dd407b154128fff80ffe9f04c588a250.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_dd407b154128fff80ffe9f04c588a250.jpg not downloaded yet
2026-03-30 11:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_29033320862646857107c9a335d315ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c3bc2b9b2dc28015128fcecbe1776831.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:08 [auto1.es] INFO: Found listing with ID: AE33071
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE33071%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.es] INFO: Scrape type for AE33071: 2
2026-03-30 11:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with identifier: AE33071
2026-03-30 11:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2, identifier: AE33071
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_d38e61aca59fe92990be02cf45a1afc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_d38e61aca59fe92990be02cf45a1afc7.jpg not downloaded yet
2026-03-30 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with identifier: AE33071
2026-03-30 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with identifier: AE33071
2026-03-30 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with identifier: AE33071 to the API
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:28:16Z',
 'fuel_type': 'hybrid',
 'id': 'c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE33071',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 39644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-29',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE33071%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.es] INFO: Saving data for AE33071: {'auction_closing_time': 1774970896.0, 'created_time': 1773131254.444794, 'last_price_update_time': 1774868708.61784}
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AE33071') HTTP/1.1" 204 0
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_c09c54d4a36b02d310b7f66ac22fae80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c09c54d4a36b02d310b7f66ac22fae80.jpg not downloaded yet
2026-03-30 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c71d0>
2026-03-30 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_848aab99b54fa533b0f6a9678ced329c.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_848aab99b54fa533b0f6a9678ced329c.jpg saved to cache
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:08 [auto1.es] INFO: Found listing with ID: EY16008
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY16008%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.es] INFO: Scrape type for EY16008: 2
2026-03-30 11:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e95ff564-e909-5d09-b7c7-50a8f59c61a6 with identifier: EY16008
2026-03-30 11:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e95ff564-e909-5d09-b7c7-50a8f59c61a6 with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e95ff564-e909-5d09-b7c7-50a8f59c61a6 with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e95ff564-e909-5d09-b7c7-50a8f59c61a6, identifier: EY16008
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_087818339aa5f8e661f9051a1f31b89b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_087818339aa5f8e661f9051a1f31b89b.jpg not downloaded yet
2026-03-30 11:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_7099d6af751bc2bd756c9cbe6068c044.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e95ff564-e909-5d09-b7c7-50a8f59c61a6 with identifier: EY16008
2026-03-30 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e95ff564-e909-5d09-b7c7-50a8f59c61a6 with identifier: EY16008
2026-03-30 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e95ff564-e909-5d09-b7c7-50a8f59c61a6 with identifier: EY16008 to the API
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:32:53Z',
 'fuel_type': 'hybrid',
 'id': 'e95ff564-e909-5d09-b7c7-50a8f59c61a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY16008',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 116479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-10',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x2 Ligne Noire',
 'transmission': 'automatic',
 'trim': '4x2 Ligne Noire',
 'year': 2022}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY16008%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.es] INFO: Saving data for EY16008: {'auction_closing_time': 1774971173.0, 'created_time': 1773131213.87213, 'last_price_update_time': 1774868709.246962}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY16008') HTTP/1.1" 204 0
2026-03-30 11:05:09 [auto1.es] INFO: Found listing with ID: RC12425
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC12425%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.es] INFO: Scrape type for RC12425: 1
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_432e6ee69b886ed1617cd4b455bc1f58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_432e6ee69b886ed1617cd4b455bc1f58.jpg not downloaded yet
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc6de5d0>
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_29033320862646857107c9a335d315ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_29033320862646857107c9a335d315ae.jpg saved to cache
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc192910>
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_c3bc2b9b2dc28015128fcecbe1776831.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c3bc2b9b2dc28015128fcecbe1776831.jpg saved to cache
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_dd407b154128fff80ffe9f04c588a250.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_c647d821864874a2102cbd0ec7bb2150.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:09 [auto1.es] INFO: Found listing with ID: WB62155
2026-03-30 11:05:09 [auto1.es] INFO: Found listing with ID: ZR40213
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR40213%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.es] INFO: Scrape type for ZR40213: 2
2026-03-30 11:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eec9077-3669-5e9d-80fe-cfe3ceabeeb3 with identifier: ZR40213
2026-03-30 11:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eec9077-3669-5e9d-80fe-cfe3ceabeeb3 with scrape type 2
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eec9077-3669-5e9d-80fe-cfe3ceabeeb3 with scrape type 2
2026-03-30 11:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7eec9077-3669-5e9d-80fe-cfe3ceabeeb3, identifier: ZR40213
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_cdb3a2f816a5aca7bca30867b6a7a153.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_cdb3a2f816a5aca7bca30867b6a7a153.jpg not downloaded yet
2026-03-30 11:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG26244> (referer: https://www.auto1.com/v1/car-details-view/FG26244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66f2cd0>
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_7099d6af751bc2bd756c9cbe6068c044.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_7099d6af751bc2bd756c9cbe6068c044.jpg saved to cache
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7eec9077-3669-5e9d-80fe-cfe3ceabeeb3 with identifier: ZR40213
2026-03-30 11:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7eec9077-3669-5e9d-80fe-cfe3ceabeeb3 with identifier: ZR40213
2026-03-30 11:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7eec9077-3669-5e9d-80fe-cfe3ceabeeb3 with identifier: ZR40213 to the API
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:14:57Z',
 'fuel_type': 'petrol',
 'id': '7eec9077-3669-5e9d-80fe-cfe3ceabeeb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR40213',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 129828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-25',
 'seller_name': None,
 'title': 'Seat Altea 1.2 TSI I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2014}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR40213%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.es] INFO: Saving data for ZR40213: {'auction_closing_time': 1774970097.0, 'created_time': 1773132606.546571, 'last_price_update_time': 1774868709.978886}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZR40213') HTTP/1.1" 204 0
2026-03-30 11:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:10 [auto1.es] INFO: Found listing with ID: BZ14545
2026-03-30 11:05:10 [auto1.es] INFO: Found listing with ID: GV98075
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV98075%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.es] INFO: Scrape type for GV98075: 2
2026-03-30 11:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110880d3-b36d-5092-8193-dae7c04db8e6 with identifier: GV98075
2026-03-30 11:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110880d3-b36d-5092-8193-dae7c04db8e6 with scrape type 2
2026-03-30 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 110880d3-b36d-5092-8193-dae7c04db8e6 with scrape type 2
2026-03-30 11:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 110880d3-b36d-5092-8193-dae7c04db8e6, identifier: GV98075
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_99c963caf1d4fa8aa5fe9946d77901fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_99c963caf1d4fa8aa5fe9946d77901fa.jpg not downloaded yet
2026-03-30 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_087818339aa5f8e661f9051a1f31b89b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 110880d3-b36d-5092-8193-dae7c04db8e6 with identifier: GV98075
2026-03-30 11:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 110880d3-b36d-5092-8193-dae7c04db8e6 with identifier: GV98075
2026-03-30 11:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 110880d3-b36d-5092-8193-dae7c04db8e6 with identifier: GV98075 to the API
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:23:21Z',
 'fuel_type': 'petrol',
 'id': '110880d3-b36d-5092-8193-dae7c04db8e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV98075',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 169078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-09',
 'seller_name': None,
 'title': 'Seat Ibiza 1.8 TSI Cupra',
 'transmission': 'manual',
 'trim': 'Cupra',
 'year': 2016}
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV98075%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.es] INFO: Saving data for GV98075: {'auction_closing_time': 1774970601.0, 'created_time': 1773691305.871818, 'last_price_update_time': 1774868710.853059}
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GV98075') HTTP/1.1" 204 0
2026-03-30 11:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6585fd0>
2026-03-30 11:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_dd407b154128fff80ffe9f04c588a250.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_dd407b154128fff80ffe9f04c588a250.jpg saved to cache
2026-03-30 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662c7d0>
2026-03-30 11:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_c647d821864874a2102cbd0ec7bb2150.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_c647d821864874a2102cbd0ec7bb2150.jpg saved to cache
2026-03-30 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:11 [auto1.es] INFO: Found listing with ID: ZH49347
2026-03-30 11:05:11 [auto1.es] INFO: Found listing with ID: ZK94271
2026-03-30 11:05:11 [auto1.es] INFO: Found listing with ID: YL98507
2026-03-30 11:05:11 [auto1.es] INFO: Found listing with ID: VH15293
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH15293%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.es] INFO: Scrape type for VH15293: 1
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_9d8eea85ee96a34065ae777584cdc05a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_9d8eea85ee96a34065ae777584cdc05a.jpg not downloaded yet
2026-03-30 11:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba692acc-c657-5f00-b573-6ff4a4cee1d9 with identifier: FG26244
2026-03-30 11:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba692acc-c657-5f00-b573-6ff4a4cee1d9 with scrape type 1
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ba692acc-c657-5f00-b573-6ff4a4cee1d9
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_5aa86d60d4653cbbcd4f1e31679ce85f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_5aa86d60d4653cbbcd4f1e31679ce85f.jpg not downloaded yet
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c09c54d4a36b02d310b7f66ac22fae80.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_432e6ee69b886ed1617cd4b455bc1f58.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.754(s), this was the 2nd time calling it.
2026-03-30 11:05:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.835009902842668 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_4350db0ce91795ac1aeedec5a30eeb16.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_4350db0ce91795ac1aeedec5a30eeb16.jpg not downloaded yet
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_deb7fd93bb05c434f16e022e35217840.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_deb7fd93bb05c434f16e022e35217840.jpg not downloaded yet
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662cd10>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_087818339aa5f8e661f9051a1f31b89b.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_087818339aa5f8e661f9051a1f31b89b.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_89d878b8972c4260156bbee2e62a002e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_89d878b8972c4260156bbee2e62a002e.jpg not downloaded yet
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_b7037c94dd00034898c01774e4d18455.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_b7037c94dd00034898c01774e4d18455.jpg not downloaded yet
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_cdb3a2f816a5aca7bca30867b6a7a153.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_d3674ac6b6c75dedb8d8af3e51033438.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_d3674ac6b6c75dedb8d8af3e51033438.jpg not downloaded yet
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_e3b8f6010469dc1a0c2dcdcb83755339.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_e3b8f6010469dc1a0c2dcdcb83755339.jpg not downloaded yet
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_d38e61aca59fe92990be02cf45a1afc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_29ba3b1dc0cfe1480dc6b19ffa65cb76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_29ba3b1dc0cfe1480dc6b19ffa65cb76.jpg not downloaded yet
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f29a90>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_c09c54d4a36b02d310b7f66ac22fae80.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c09c54d4a36b02d310b7f66ac22fae80.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6511950>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_432e6ee69b886ed1617cd4b455bc1f58.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_432e6ee69b886ed1617cd4b455bc1f58.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_99c963caf1d4fa8aa5fe9946d77901fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_e77a743030fbbdd693df5f6435bc6ae0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_e77a743030fbbdd693df5f6435bc6ae0.jpg not downloaded yet
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_deb7fd93bb05c434f16e022e35217840.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb654a1d0>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_cdb3a2f816a5aca7bca30867b6a7a153.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_cdb3a2f816a5aca7bca30867b6a7a153.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd0074d0>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_d38e61aca59fe92990be02cf45a1afc7.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_d38e61aca59fe92990be02cf45a1afc7.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_e3b8f6010469dc1a0c2dcdcb83755339.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_d3674ac6b6c75dedb8d8af3e51033438.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc225fd0>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_99c963caf1d4fa8aa5fe9946d77901fa.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_99c963caf1d4fa8aa5fe9946d77901fa.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_29ba3b1dc0cfe1480dc6b19ffa65cb76.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66af910>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_deb7fd93bb05c434f16e022e35217840.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_deb7fd93bb05c434f16e022e35217840.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba692acc-c657-5f00-b573-6ff4a4cee1d9
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_b7037c94dd00034898c01774e4d18455.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6567b90>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_e3b8f6010469dc1a0c2dcdcb83755339.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_e3b8f6010469dc1a0c2dcdcb83755339.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba692acc-c657-5f00-b573-6ff4a4cee1d9
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_89d878b8972c4260156bbee2e62a002e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_4350db0ce91795ac1aeedec5a30eeb16.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66af810>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_d3674ac6b6c75dedb8d8af3e51033438.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_d3674ac6b6c75dedb8d8af3e51033438.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f4f910>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_29ba3b1dc0cfe1480dc6b19ffa65cb76.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_29ba3b1dc0cfe1480dc6b19ffa65cb76.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba692acc-c657-5f00-b573-6ff4a4cee1d9
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6434c50>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_b7037c94dd00034898c01774e4d18455.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_b7037c94dd00034898c01774e4d18455.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba692acc-c657-5f00-b573-6ff4a4cee1d9
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_e77a743030fbbdd693df5f6435bc6ae0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_5aa86d60d4653cbbcd4f1e31679ce85f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_9d8eea85ee96a34065ae777584cdc05a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65b4590>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_89d878b8972c4260156bbee2e62a002e.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_89d878b8972c4260156bbee2e62a002e.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66a4790>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_4350db0ce91795ac1aeedec5a30eeb16.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_4350db0ce91795ac1aeedec5a30eeb16.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fcb210>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_e77a743030fbbdd693df5f6435bc6ae0.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_e77a743030fbbdd693df5f6435bc6ae0.jpg saved to cache
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba692acc-c657-5f00-b573-6ff4a4cee1d9
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f4cdd0>
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F66%252F4666ff09b0fdda199239489e2b1f15f7%252Fpa%252FFG26244_5aa86d60d4653cbbcd4f1e31679ce85f.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_5aa86d60d4653cbbcd4f1e31679ce85f.jpg saved to cache
2026-03-30 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba692acc-c657-5f00-b573-6ff4a4cee1d9
2026-03-30 11:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba692acc-c657-5f00-b573-6ff4a4cee1d9, skipping ID generation
2026-03-30 11:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba692acc-c657-5f00-b573-6ff4a4cee1d9 with scrape type 1
2026-03-30 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba692acc-c657-5f00-b573-6ff4a4cee1d9 sending to next pipeline
2026-03-30 11:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ba692acc-c657-5f00-b573-6ff4a4cee1d9, identifier: FG26244
2026-03-30 11:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ba692acc-c657-5f00-b573-6ff4a4cee1d9 with identifier: FG26244
2026-03-30 11:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ba692acc-c657-5f00-b573-6ff4a4cee1d9 with identifier: FG26244
2026-03-30 11:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ba692acc-c657-5f00-b573-6ff4a4cee1d9 with identifier: FG26244 to the API
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_5aa86d60d4653cbbcd4f1e31679ce85f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:12:25Z',
 'fuel_type': 'diesel',
 'id': 'ba692acc-c657-5f00-b573-6ff4a4cee1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG26244',
 'listing': 'auction',
 'location': 'ES, Las Lagunas de Mijas',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 488450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_5aa86d60d4653cbbcd4f1e31679ce85f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_deb7fd93bb05c434f16e022e35217840.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_b7037c94dd00034898c01774e4d18455.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_e3b8f6010469dc1a0c2dcdcb83755339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_29ba3b1dc0cfe1480dc6b19ffa65cb76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba692acc-c657-5f00-b573-6ff4a4cee1d9/ba692acc-c657-5f00-b573-6ff4a4cee1d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/66/4666ff09b0fdda199239489e2b1f15f7/pa/FG26244_e77a743030fbbdd693df5f6435bc6ae0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2006}
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG26244%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.es] INFO: Saving data for FG26244: {'created_time': 1774868712.629286, 'last_price_update_time': 1774868712.629296, 'auction_closing_time': 1774969945.0}
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG26244') HTTP/1.1" 204 0
2026-03-30 11:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c743e3b7fee1620fe642a9ea2872048a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU48327> (referer: https://www.auto1.com/v1/car-details-view/WU48327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbcfa7210>
2026-03-30 11:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F48%252F8f48915fe4dbd6041514567423cb17c5%252Fpa%252FFT58474_9d8eea85ee96a34065ae777584cdc05a.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_9d8eea85ee96a34065ae777584cdc05a.jpg saved to cache
2026-03-30 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5202fb29-d750-5087-b345-5fd14272d8cb
2026-03-30 11:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5202fb29-d750-5087-b345-5fd14272d8cb, skipping ID generation
2026-03-30 11:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5202fb29-d750-5087-b345-5fd14272d8cb with scrape type 1
2026-03-30 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5202fb29-d750-5087-b345-5fd14272d8cb sending to next pipeline
2026-03-30 11:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5202fb29-d750-5087-b345-5fd14272d8cb, identifier: FT58474
2026-03-30 11:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5202fb29-d750-5087-b345-5fd14272d8cb with identifier: FT58474
2026-03-30 11:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5202fb29-d750-5087-b345-5fd14272d8cb with identifier: FT58474
2026-03-30 11:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5202fb29-d750-5087-b345-5fd14272d8cb with identifier: FT58474 to the API
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_9d8eea85ee96a34065ae777584cdc05a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:35:56Z',
 'fuel_type': 'diesel',
 'id': '5202fb29-d750-5087-b345-5fd14272d8cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT58474',
 'listing': 'auction',
 'location': 'ES, Majadahonda, Madrid',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 181225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_c647d821864874a2102cbd0ec7bb2150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_d38e61aca59fe92990be02cf45a1afc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_087818339aa5f8e661f9051a1f31b89b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_432e6ee69b886ed1617cd4b455bc1f58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_cdb3a2f816a5aca7bca30867b6a7a153.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_99c963caf1d4fa8aa5fe9946d77901fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_9d8eea85ee96a34065ae777584cdc05a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_4350db0ce91795ac1aeedec5a30eeb16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_89d878b8972c4260156bbee2e62a002e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202fb29-d750-5087-b345-5fd14272d8cb/5202fb29-d750-5087-b345-5fd14272d8cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/48/8f48915fe4dbd6041514567423cb17c5/pa/FT58474_d3674ac6b6c75dedb8d8af3e51033438.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT58474%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.es] INFO: Saving data for FT58474: {'created_time': 1774868713.20042, 'last_price_update_time': 1774868713.200431, 'auction_closing_time': 1774971356.0}
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FT58474') HTTP/1.1" 204 0
2026-03-30 11:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML73302> (referer: https://www.auto1.com/v1/car-details-view/ML73302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb656ffd0>
2026-03-30 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F7f%252Fb97fcea3f4508dd8771f3431b4aa6f59%252Fpa%252FUY14262_c743e3b7fee1620fe642a9ea2872048a.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c743e3b7fee1620fe642a9ea2872048a.jpg saved to cache
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90e33010-cea2-51f3-a725-9404191b5ae4
2026-03-30 11:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90e33010-cea2-51f3-a725-9404191b5ae4, skipping ID generation
2026-03-30 11:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90e33010-cea2-51f3-a725-9404191b5ae4 with scrape type 1
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90e33010-cea2-51f3-a725-9404191b5ae4 sending to next pipeline
2026-03-30 11:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90e33010-cea2-51f3-a725-9404191b5ae4, identifier: UY14262
2026-03-30 11:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7300810-02ba-514c-87d9-33988310a77a with identifier: WU48327
2026-03-30 11:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7300810-02ba-514c-87d9-33988310a77a with scrape type 1
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7300810-02ba-514c-87d9-33988310a77a
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_ce4ed7c9efb567703bd951a84fc92235.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_ce4ed7c9efb567703bd951a84fc92235.jpg already downloaded
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_60795a50a227f7e3d2058cbe90c5e257.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_60795a50a227f7e3d2058cbe90c5e257.jpg already downloaded
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_e29f7c7d772550fdc6317a333c43d329.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_e29f7c7d772550fdc6317a333c43d329.jpg already downloaded
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_9a91d3a150ca898fab2fdbcde96444d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_9a91d3a150ca898fab2fdbcde96444d4.jpg already downloaded
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_fd4d50c499034919aa0500af2886187a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_fd4d50c499034919aa0500af2886187a.jpg already downloaded
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_05f7da5134fff2d910fad62e54870cda.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_05f7da5134fff2d910fad62e54870cda.jpg already downloaded
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_c44effb34fa10c8d53b3b354da9efc69.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_c44effb34fa10c8d53b3b354da9efc69.jpg already downloaded
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_b912a9d7b6fceadd75e001373fad70ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_b912a9d7b6fceadd75e001373fad70ba.jpg already downloaded
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_7fa3fcc6f147c3df9fbc867bc16558a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_7fa3fcc6f147c3df9fbc867bc16558a1.jpg already downloaded
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0c%252F400cb5eb57b8c8a92c307a40d3ecacd2%252Fpa%252FWU48327_f30beab35accd42a61089c73643d110c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_f30beab35accd42a61089c73643d110c.jpg already downloaded
2026-03-30 11:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7300810-02ba-514c-87d9-33988310a77a, identifier: WU48327
2026-03-30 11:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90e33010-cea2-51f3-a725-9404191b5ae4 with identifier: UY14262
2026-03-30 11:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90e33010-cea2-51f3-a725-9404191b5ae4 with identifier: UY14262
2026-03-30 11:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90e33010-cea2-51f3-a725-9404191b5ae4 with identifier: UY14262 to the API
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c743e3b7fee1620fe642a9ea2872048a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:41:47Z',
 'fuel_type': 'diesel',
 'id': '90e33010-cea2-51f3-a725-9404191b5ae4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY14262',
 'listing': 'auction',
 'location': 'ES, Vic',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 129964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_02dde017335a9602d8a34a2f6ed4df23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_9ae159c3b737a8fbc86048568707b308.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_be1db5f0273f817e16612eb63cec864e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_848aab99b54fa533b0f6a9678ced329c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c3bc2b9b2dc28015128fcecbe1776831.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_29033320862646857107c9a335d315ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_7099d6af751bc2bd756c9cbe6068c044.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c743e3b7fee1620fe642a9ea2872048a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_dd407b154128fff80ffe9f04c588a250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90e33010-cea2-51f3-a725-9404191b5ae4/90e33010-cea2-51f3-a725-9404191b5ae4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7f/b97fcea3f4508dd8771f3431b4aa6f59/pa/UY14262_c09c54d4a36b02d310b7f66ac22fae80.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.5 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY14262%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [auto1.es] INFO: Saving data for UY14262: {'created_time': 1774868714.028582, 'last_price_update_time': 1774868714.028593, 'auction_closing_time': 1774971707.0}
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UY14262') HTTP/1.1" 204 0
2026-03-30 11:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7300810-02ba-514c-87d9-33988310a77a with identifier: WU48327
2026-03-30 11:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7300810-02ba-514c-87d9-33988310a77a with identifier: WU48327
2026-03-30 11:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7300810-02ba-514c-87d9-33988310a77a with identifier: WU48327 to the API
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU48327>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:04:27Z',
 'fuel_type': 'petrol',
 'id': 'f7300810-02ba-514c-87d9-33988310a77a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU48327',
 'listing': 'auction',
 'location': 'Palma de Mallorca',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 216678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_ce4ed7c9efb567703bd951a84fc92235.jpg',
                'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_60795a50a227f7e3d2058cbe90c5e257.jpg',
                'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_e29f7c7d772550fdc6317a333c43d329.jpg',
                'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_9a91d3a150ca898fab2fdbcde96444d4.jpg',
                'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_fd4d50c499034919aa0500af2886187a.jpg',
                'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_05f7da5134fff2d910fad62e54870cda.jpg',
                'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_c44effb34fa10c8d53b3b354da9efc69.jpg',
                'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_b912a9d7b6fceadd75e001373fad70ba.jpg',
                'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_7fa3fcc6f147c3df9fbc867bc16558a1.jpg',
                'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_f30beab35accd42a61089c73643d110c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_ce4ed7c9efb567703bd951a84fc92235.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_60795a50a227f7e3d2058cbe90c5e257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_e29f7c7d772550fdc6317a333c43d329.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_9a91d3a150ca898fab2fdbcde96444d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_fd4d50c499034919aa0500af2886187a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_05f7da5134fff2d910fad62e54870cda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_c44effb34fa10c8d53b3b354da9efc69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_b912a9d7b6fceadd75e001373fad70ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_7fa3fcc6f147c3df9fbc867bc16558a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7300810-02ba-514c-87d9-33988310a77a/f7300810-02ba-514c-87d9-33988310a77a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0c/400cb5eb57b8c8a92c307a40d3ecacd2/pa/WU48327_f30beab35accd42a61089c73643d110c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU48327%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [auto1.es] INFO: Saving data for WU48327: {'created_time': 1774868714.366626, 'last_price_update_time': 1774868714.366638, 'auction_closing_time': 1774969467.0}
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU48327') HTTP/1.1" 204 0
2026-03-30 11:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32362787-7f5b-5276-a978-58af7c9d06b8 with identifier: ML73302
2026-03-30 11:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32362787-7f5b-5276-a978-58af7c9d06b8 with scrape type 1
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32362787-7f5b-5276-a978-58af7c9d06b8
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_d8f5f63ee74113a1d4bea21a1b9692ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_d8f5f63ee74113a1d4bea21a1b9692ac.jpg already downloaded
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_7d6dce9eede6f659e5db4ee0dbf381c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_7d6dce9eede6f659e5db4ee0dbf381c7.jpg already downloaded
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_e3d43a1fcbef5b8303f2024c653fc408.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_e3d43a1fcbef5b8303f2024c653fc408.jpg already downloaded
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_ea45bd2dc22452920abb31358fe4901a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_ea45bd2dc22452920abb31358fe4901a.jpg already downloaded
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_d151d089ae7fa7115a5ffdb19780c1ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_d151d089ae7fa7115a5ffdb19780c1ec.jpg already downloaded
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_99a54af26427918e75681e5ba3f0cd0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_99a54af26427918e75681e5ba3f0cd0c.jpg already downloaded
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_1348f291dd9a1fb97aee02f41eaae83d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_1348f291dd9a1fb97aee02f41eaae83d.jpg already downloaded
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_2ac3839a57cf378c436fa6ba0d9ca935.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_2ac3839a57cf378c436fa6ba0d9ca935.jpg already downloaded
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_72b1b89f85e7bcf49280cf51f2865c4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_72b1b89f85e7bcf49280cf51f2865c4d.jpg already downloaded
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd1247a1ad07ea7000c3f8655812b3581%252Fpa%252FML73302_0ee99c46ff9fa1627551a3f50be33de4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_0ee99c46ff9fa1627551a3f50be33de4.jpg already downloaded
2026-03-30 11:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 32362787-7f5b-5276-a978-58af7c9d06b8, identifier: ML73302
2026-03-30 11:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 32362787-7f5b-5276-a978-58af7c9d06b8 with identifier: ML73302
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 11:05:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 32362787-7f5b-5276-a978-58af7c9d06b8 with identifier: ML73302
2026-03-30 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 32362787-7f5b-5276-a978-58af7c9d06b8 with identifier: ML73302 to the API
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML73302>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:31:22Z',
 'fuel_type': 'diesel',
 'id': '32362787-7f5b-5276-a978-58af7c9d06b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML73302',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 241943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_d8f5f63ee74113a1d4bea21a1b9692ac.jpg',
                'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_7d6dce9eede6f659e5db4ee0dbf381c7.jpg',
                'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_e3d43a1fcbef5b8303f2024c653fc408.jpg',
                'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_ea45bd2dc22452920abb31358fe4901a.jpg',
                'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_d151d089ae7fa7115a5ffdb19780c1ec.jpg',
                'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_99a54af26427918e75681e5ba3f0cd0c.jpg',
                'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_1348f291dd9a1fb97aee02f41eaae83d.jpg',
                'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_2ac3839a57cf378c436fa6ba0d9ca935.jpg',
                'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_72b1b89f85e7bcf49280cf51f2865c4d.jpg',
                'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_0ee99c46ff9fa1627551a3f50be33de4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_d8f5f63ee74113a1d4bea21a1b9692ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_7d6dce9eede6f659e5db4ee0dbf381c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_e3d43a1fcbef5b8303f2024c653fc408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_ea45bd2dc22452920abb31358fe4901a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_d151d089ae7fa7115a5ffdb19780c1ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_99a54af26427918e75681e5ba3f0cd0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_1348f291dd9a1fb97aee02f41eaae83d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_2ac3839a57cf378c436fa6ba0d9ca935.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_72b1b89f85e7bcf49280cf51f2865c4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32362787-7f5b-5276-a978-58af7c9d06b8/32362787-7f5b-5276-a978-58af7c9d06b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d1247a1ad07ea7000c3f8655812b3581/pa/ML73302_0ee99c46ff9fa1627551a3f50be33de4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML73302%27 HTTP/1.1" 200 None
2026-03-30 11:05:15 [auto1.es] INFO: Saving data for ML73302: {'created_time': 1774868715.262919, 'last_price_update_time': 1774868715.262928, 'auction_closing_time': 1774971082.0}
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ML73302') HTTP/1.1" 204 0
2026-03-30 11:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY68664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS18860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:05:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.416(s), this was the 2nd time calling it.
2026-03-30 11:05:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.141844062788235 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:05:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.774(s), this was the 2nd time calling it.
2026-03-30 11:05:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.052319146025599 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH67145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN25328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH15293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY68664> (referer: https://www.auto1.com/v1/car-details-view/SY68664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90a8d3a2-9e77-5b06-bbd4-b385d9257cde with identifier: SY68664
2026-03-30 11:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde with scrape type 1
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_ea7fe5637042fab7eb1b9332e66120fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_ea7fe5637042fab7eb1b9332e66120fc.jpg not downloaded yet
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_173cae3478a5dcbcec0444e4039e547d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_173cae3478a5dcbcec0444e4039e547d.jpg not downloaded yet
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_5216544e7faf1f220d7aeb306c60fb0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_5216544e7faf1f220d7aeb306c60fb0b.jpg not downloaded yet
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_5b54b0c67fafb21a62e20959500d1022.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_5b54b0c67fafb21a62e20959500d1022.jpg not downloaded yet
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_747cb66feefd1c36bd7e006bc58eda19.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_747cb66feefd1c36bd7e006bc58eda19.jpg not downloaded yet
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_dfbdd0648449141a01c73fe9c1bdc802.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_dfbdd0648449141a01c73fe9c1bdc802.jpg not downloaded yet
2026-03-30 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_ea7fe5637042fab7eb1b9332e66120fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_173cae3478a5dcbcec0444e4039e547d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_5216544e7faf1f220d7aeb306c60fb0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_5b54b0c67fafb21a62e20959500d1022.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc0b0890>
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_ea7fe5637042fab7eb1b9332e66120fc.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_ea7fe5637042fab7eb1b9332e66120fc.jpg saved to cache
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc0d7dd0>
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_173cae3478a5dcbcec0444e4039e547d.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_173cae3478a5dcbcec0444e4039e547d.jpg saved to cache
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65664d0>
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_5216544e7faf1f220d7aeb306c60fb0b.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_5216544e7faf1f220d7aeb306c60fb0b.jpg saved to cache
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc190450>
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_5b54b0c67fafb21a62e20959500d1022.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_5b54b0c67fafb21a62e20959500d1022.jpg saved to cache
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde
2026-03-30 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_dfbdd0648449141a01c73fe9c1bdc802.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_747cb66feefd1c36bd7e006bc58eda19.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6512cd0>
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_dfbdd0648449141a01c73fe9c1bdc802.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_dfbdd0648449141a01c73fe9c1bdc802.jpg saved to cache
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd007cd0>
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd4%252F02d411da0bfe2e2f654dc8749bc4f87d%252Fpa%252FSY68664_747cb66feefd1c36bd7e006bc58eda19.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_747cb66feefd1c36bd7e006bc58eda19.jpg saved to cache
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde
2026-03-30 11:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90a8d3a2-9e77-5b06-bbd4-b385d9257cde, skipping ID generation
2026-03-30 11:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde with scrape type 1
2026-03-30 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90a8d3a2-9e77-5b06-bbd4-b385d9257cde sending to next pipeline
2026-03-30 11:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90a8d3a2-9e77-5b06-bbd4-b385d9257cde, identifier: SY68664
2026-03-30 11:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90a8d3a2-9e77-5b06-bbd4-b385d9257cde with identifier: SY68664
2026-03-30 11:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90a8d3a2-9e77-5b06-bbd4-b385d9257cde with identifier: SY68664
2026-03-30 11:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90a8d3a2-9e77-5b06-bbd4-b385d9257cde with identifier: SY68664 to the API
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_747cb66feefd1c36bd7e006bc58eda19.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:59:08Z',
 'fuel_type': 'diesel',
 'id': '90a8d3a2-9e77-5b06-bbd4-b385d9257cde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY68664',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 80982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_ea7fe5637042fab7eb1b9332e66120fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_173cae3478a5dcbcec0444e4039e547d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_5216544e7faf1f220d7aeb306c60fb0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_5b54b0c67fafb21a62e20959500d1022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_747cb66feefd1c36bd7e006bc58eda19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90a8d3a2-9e77-5b06-bbd4-b385d9257cde/90a8d3a2-9e77-5b06-bbd4-b385d9257cde_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/d4/02d411da0bfe2e2f654dc8749bc4f87d/pa/SY68664_dfbdd0648449141a01c73fe9c1bdc802.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2009}
2026-03-30 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY68664%27 HTTP/1.1" 200 None
2026-03-30 11:05:29 [auto1.es] INFO: Saving data for SY68664: {'created_time': 1774868729.093799, 'last_price_update_time': 1774868729.09381, 'auction_closing_time': 1774972748.0}
2026-03-30 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SY68664') HTTP/1.1" 204 0
2026-03-30 11:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC82421/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:35 [auto1.es] INFO: Channel: 24h | Page: 7 | totalHits: 2195 | hits on page: 40
2026-03-30 11:05:35 [auto1.es] INFO: Found listing with ID: VH15293
2026-03-30 11:05:35 [auto1.es] INFO: Found listing with ID: KX02596
2026-03-30 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX02596%27 HTTP/1.1" 200 None
2026-03-30 11:05:35 [auto1.es] INFO: Scrape type for KX02596: 2
2026-03-30 11:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with identifier: KX02596
2026-03-30 11:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with scrape type 2
2026-03-30 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with scrape type 2
2026-03-30 11:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9, identifier: KX02596
2026-03-30 11:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with identifier: KX02596
2026-03-30 11:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with identifier: KX02596
2026-03-30 11:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with identifier: KX02596 to the API
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:21:50Z',
 'fuel_type': 'petrol',
 'id': '92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX02596',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS9',
 'odometer': 21626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seller_name': None,
 'title': 'DS Automobiles DS9 1.6 PureTech Rivoli +',
 'transmission': 'automatic',
 'trim': 'Rivoli +',
 'year': 2022}
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX02596%27 HTTP/1.1" 200 None
2026-03-30 11:05:36 [auto1.es] INFO: Saving data for KX02596: {'auction_closing_time': 1774970510.0, 'created_time': 1773691539.173706, 'last_price_update_time': 1774868736.362987}
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX02596') HTTP/1.1" 204 0
2026-03-30 11:05:36 [auto1.es] INFO: Found listing with ID: FE56951
2026-03-30 11:05:36 [auto1.es] INFO: Found listing with ID: RD14633
2026-03-30 11:05:36 [auto1.es] INFO: Found listing with ID: AJ53679
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ53679%27 HTTP/1.1" 200 None
2026-03-30 11:05:36 [auto1.es] INFO: Scrape type for AJ53679: 2
2026-03-30 11:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2661d55b-356b-51e7-960a-f4b591bc197d with identifier: AJ53679
2026-03-30 11:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2661d55b-356b-51e7-960a-f4b591bc197d with scrape type 2
2026-03-30 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2661d55b-356b-51e7-960a-f4b591bc197d with scrape type 2
2026-03-30 11:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2661d55b-356b-51e7-960a-f4b591bc197d, identifier: AJ53679
2026-03-30 11:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2661d55b-356b-51e7-960a-f4b591bc197d with identifier: AJ53679
2026-03-30 11:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2661d55b-356b-51e7-960a-f4b591bc197d with identifier: AJ53679
2026-03-30 11:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2661d55b-356b-51e7-960a-f4b591bc197d with identifier: AJ53679 to the API
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:06:01Z',
 'fuel_type': 'petrol',
 'id': '2661d55b-356b-51e7-960a-f4b591bc197d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ53679',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 41263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-24',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ53679%27 HTTP/1.1" 200 None
2026-03-30 11:05:36 [auto1.es] INFO: Saving data for AJ53679: {'auction_closing_time': 1774969561.0, 'created_time': 1774263726.780927, 'last_price_update_time': 1774868736.866084}
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ53679') HTTP/1.1" 204 0
2026-03-30 11:05:36 [auto1.es] INFO: Found listing with ID: AX54555
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX54555%27 HTTP/1.1" 200 None
2026-03-30 11:05:36 [auto1.es] INFO: Scrape type for AX54555: 1
2026-03-30 11:05:36 [auto1.es] INFO: Found listing with ID: UA88301
2026-03-30 11:05:36 [auto1.es] INFO: Found listing with ID: FN90345
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN90345%27 HTTP/1.1" 200 None
2026-03-30 11:05:36 [auto1.es] INFO: Scrape type for FN90345: 2
2026-03-30 11:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with identifier: FN90345
2026-03-30 11:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with scrape type 2
2026-03-30 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with scrape type 2
2026-03-30 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 63566c54-c7d1-5f83-ad65-4988d95bdcb0, identifier: FN90345
2026-03-30 11:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with identifier: FN90345
2026-03-30 11:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with identifier: FN90345
2026-03-30 11:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with identifier: FN90345 to the API
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:17:13Z',
 'fuel_type': 'petrol',
 'id': '63566c54-c7d1-5f83-ad65-4988d95bdcb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN90345',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 19230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Feel Pack',
 'transmission': 'manual',
 'trim': 'Feel Pack',
 'year': 2023}
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN90345%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [auto1.es] INFO: Saving data for FN90345: {'auction_closing_time': 1774970233.0, 'created_time': 1773132182.687038, 'last_price_update_time': 1774868737.405563}
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN90345') HTTP/1.1" 204 0
2026-03-30 11:05:37 [auto1.es] INFO: Found listing with ID: TT54847
2026-03-30 11:05:37 [auto1.es] INFO: Found listing with ID: VV73300
2026-03-30 11:05:37 [auto1.es] INFO: Found listing with ID: CT70526
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT70526%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [auto1.es] INFO: Scrape type for CT70526: 1
2026-03-30 11:05:37 [auto1.es] INFO: Found listing with ID: AT54546
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT54546%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [auto1.es] INFO: Scrape type for AT54546: 2
2026-03-30 11:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a5d825-803b-59d6-ab73-cf6a0d358751 with identifier: AT54546
2026-03-30 11:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a5d825-803b-59d6-ab73-cf6a0d358751 with scrape type 2
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a5d825-803b-59d6-ab73-cf6a0d358751 with scrape type 2
2026-03-30 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e1a5d825-803b-59d6-ab73-cf6a0d358751, identifier: AT54546
2026-03-30 11:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e1a5d825-803b-59d6-ab73-cf6a0d358751 with identifier: AT54546
2026-03-30 11:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e1a5d825-803b-59d6-ab73-cf6a0d358751 with identifier: AT54546
2026-03-30 11:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e1a5d825-803b-59d6-ab73-cf6a0d358751 with identifier: AT54546 to the API
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:43:01Z',
 'fuel_type': 'petrol',
 'id': 'e1a5d825-803b-59d6-ab73-cf6a0d358751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT54546',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 38152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Feel Pack',
 'transmission': 'manual',
 'trim': 'Feel Pack',
 'year': 2023}
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT54546%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [auto1.es] INFO: Saving data for AT54546: {'auction_closing_time': 1774971781.0, 'created_time': 1773132208.161203, 'last_price_update_time': 1774868738.05336}
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AT54546') HTTP/1.1" 204 0
2026-03-30 11:05:38 [auto1.es] INFO: Found listing with ID: JW87659
2026-03-30 11:05:38 [auto1.es] INFO: Found listing with ID: ZH70186
2026-03-30 11:05:38 [auto1.es] INFO: Found listing with ID: AG97977
2026-03-30 11:05:38 [auto1.es] INFO: Found listing with ID: VC29718
2026-03-30 11:05:38 [auto1.es] INFO: Found listing with ID: VN77018
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN77018%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [auto1.es] INFO: Scrape type for VN77018: 2
2026-03-30 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b89159-71ff-5b33-a7cc-6b3029f8e178 with identifier: VN77018
2026-03-30 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b89159-71ff-5b33-a7cc-6b3029f8e178 with scrape type 2
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b89159-71ff-5b33-a7cc-6b3029f8e178 with scrape type 2
2026-03-30 11:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0b89159-71ff-5b33-a7cc-6b3029f8e178, identifier: VN77018
2026-03-30 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0b89159-71ff-5b33-a7cc-6b3029f8e178 with identifier: VN77018
2026-03-30 11:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0b89159-71ff-5b33-a7cc-6b3029f8e178 with identifier: VN77018
2026-03-30 11:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0b89159-71ff-5b33-a7cc-6b3029f8e178 with identifier: VN77018 to the API
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:49:47Z',
 'fuel_type': 'petrol',
 'id': 'b0b89159-71ff-5b33-a7cc-6b3029f8e178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN77018',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 49281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Connected Chic',
 'transmission': 'manual',
 'trim': 'Connected Chic',
 'year': 2021}
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN77018%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [auto1.es] INFO: Saving data for VN77018: {'auction_closing_time': 1774972187.0, 'created_time': 1773131685.681137, 'last_price_update_time': 1774868738.593827}
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VN77018') HTTP/1.1" 204 0
2026-03-30 11:05:38 [auto1.es] INFO: Found listing with ID: UF23429
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF23429%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [auto1.es] INFO: Scrape type for UF23429: 2
2026-03-30 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with identifier: UF23429
2026-03-30 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with scrape type 2
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with scrape type 2
2026-03-30 11:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13619934-ca5f-51b9-b4b8-0392cc49a6e6, identifier: UF23429
2026-03-30 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with identifier: UF23429
2026-03-30 11:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with identifier: UF23429
2026-03-30 11:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with identifier: UF23429 to the API
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:27:47Z',
 'fuel_type': 'petrol',
 'id': '13619934-ca5f-51b9-b4b8-0392cc49a6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF23429',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 82605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-21',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF23429%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.es] INFO: Saving data for UF23429: {'auction_closing_time': 1774970867.0, 'created_time': 1774361218.862067, 'last_price_update_time': 1774868739.107094}
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF23429') HTTP/1.1" 204 0
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: FH67818
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: VL80227
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: WG01714
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: VT88703
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT88703%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.es] INFO: Scrape type for VT88703: 1
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: ZC57359
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC57359%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.es] INFO: Scrape type for ZC57359: 2
2026-03-30 11:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f80241-5385-570e-9086-fd1340c493ad with identifier: ZC57359
2026-03-30 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f80241-5385-570e-9086-fd1340c493ad with scrape type 2
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f80241-5385-570e-9086-fd1340c493ad with scrape type 2
2026-03-30 11:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24f80241-5385-570e-9086-fd1340c493ad, identifier: ZC57359
2026-03-30 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24f80241-5385-570e-9086-fd1340c493ad with identifier: ZC57359
2026-03-30 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24f80241-5385-570e-9086-fd1340c493ad with identifier: ZC57359
2026-03-30 11:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24f80241-5385-570e-9086-fd1340c493ad with identifier: ZC57359 to the API
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:21:05Z',
 'fuel_type': 'diesel',
 'id': '24f80241-5385-570e-9086-fd1340c493ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC57359',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 64381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-21',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC57359%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.es] INFO: Saving data for ZC57359: {'auction_closing_time': 1774970465.0, 'created_time': 1773132446.475758, 'last_price_update_time': 1774868739.692633}
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZC57359') HTTP/1.1" 204 0
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: WB45577
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB45577%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.es] INFO: Scrape type for WB45577: 1
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: LJ23140
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: TV97733
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV97733%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.es] INFO: Scrape type for TV97733: 1
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: JT74362
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT74362%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.es] INFO: Scrape type for JT74362: 1
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: ET64130
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: NZ17850
2026-03-30 11:05:39 [auto1.es] INFO: Found listing with ID: WL07406
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL07406%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.es] INFO: Scrape type for WL07406: 2
2026-03-30 11:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d2f731-f012-595b-ad24-345806a8093a with identifier: WL07406
2026-03-30 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d2f731-f012-595b-ad24-345806a8093a with scrape type 2
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68d2f731-f012-595b-ad24-345806a8093a with scrape type 2
2026-03-30 11:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68d2f731-f012-595b-ad24-345806a8093a, identifier: WL07406
2026-03-30 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68d2f731-f012-595b-ad24-345806a8093a with identifier: WL07406
2026-03-30 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68d2f731-f012-595b-ad24-345806a8093a with identifier: WL07406
2026-03-30 11:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 68d2f731-f012-595b-ad24-345806a8093a with identifier: WL07406 to the API
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:15:59Z',
 'fuel_type': 'diesel',
 'id': '68d2f731-f012-595b-ad24-345806a8093a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL07406',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 161126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-20',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi SoChic',
 'transmission': 'automatic',
 'trim': 'SoChic',
 'year': 2021}
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL07406%27 HTTP/1.1" 200 None
2026-03-30 11:05:40 [auto1.es] INFO: Saving data for WL07406: {'auction_closing_time': 1774970159.0, 'created_time': 1773132159.544642, 'last_price_update_time': 1774868740.874044}
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WL07406') HTTP/1.1" 204 0
2026-03-30 11:05:40 [auto1.es] INFO: Found listing with ID: TK17628
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK17628%27 HTTP/1.1" 200 None
2026-03-30 11:05:40 [auto1.es] INFO: Scrape type for TK17628: 1
2026-03-30 11:05:40 [auto1.es] INFO: Found listing with ID: JL80339
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL80339%27 HTTP/1.1" 200 None
2026-03-30 11:05:40 [auto1.es] INFO: Scrape type for JL80339: 2
2026-03-30 11:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with identifier: JL80339
2026-03-30 11:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with scrape type 2
2026-03-30 11:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with scrape type 2
2026-03-30 11:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 528709e4-2667-5b17-9c1b-d3ce9ce409d3, identifier: JL80339
2026-03-30 11:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH67145> (referer: https://www.auto1.com/v1/car-details-view/VH67145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with identifier: JL80339
2026-03-30 11:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with identifier: JL80339
2026-03-30 11:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with identifier: JL80339 to the API
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:46:09Z',
 'fuel_type': 'diesel',
 'id': '528709e4-2667-5b17-9c1b-d3ce9ce409d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL80339',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 46424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-06',
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL80339%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.es] INFO: Saving data for JL80339: {'auction_closing_time': 1774971969.0, 'created_time': 1773131721.977985, 'last_price_update_time': 1774868741.660131}
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JL80339') HTTP/1.1" 204 0
2026-03-30 11:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:41 [auto1.es] INFO: Found listing with ID: WC29009
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC29009%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.es] INFO: Scrape type for WC29009: 1
2026-03-30 11:05:41 [auto1.es] INFO: Found listing with ID: BW36517
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW36517%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.es] INFO: Scrape type for BW36517: 1
2026-03-30 11:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b29b3eba-8a51-53ef-b553-ab27a0047b72 with identifier: VH67145
2026-03-30 11:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b29b3eba-8a51-53ef-b553-ab27a0047b72 with scrape type 1
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b29b3eba-8a51-53ef-b553-ab27a0047b72
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_5d2617d895b848da90f74316ef1cce28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_5d2617d895b848da90f74316ef1cce28.jpg already downloaded
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_787a53c906b7fa9856543ae6b679d0c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_787a53c906b7fa9856543ae6b679d0c9.jpg already downloaded
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_37124e4b2d900b37503c5168bdf901b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_37124e4b2d900b37503c5168bdf901b4.jpg already downloaded
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_3de316e110c7c6e15ac1adc9a595d955.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_3de316e110c7c6e15ac1adc9a595d955.jpg already downloaded
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_996d2460d7e19e007a25739ec8f14b6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_996d2460d7e19e007a25739ec8f14b6c.jpg already downloaded
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_879547a65666b9e9b1e60690a22358e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_879547a65666b9e9b1e60690a22358e8.jpg already downloaded
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_fbd2b0366124f74c2fe565ea79989b01.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_fbd2b0366124f74c2fe565ea79989b01.jpg already downloaded
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_c0b5f504c86efcbfbcb1a4f4ca47d1e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_c0b5f504c86efcbfbcb1a4f4ca47d1e1.jpg already downloaded
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_7871bb84ef336c0259bdbd8b36f685ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_7871bb84ef336c0259bdbd8b36f685ef.jpg already downloaded
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F3c%252Fc03ccbeb098451eee02513c4480a4034%252Fpa%252FVH67145_b01241f6a759d563d47c1e09a548d4cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_b01241f6a759d563d47c1e09a548d4cf.jpg already downloaded
2026-03-30 11:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b29b3eba-8a51-53ef-b553-ab27a0047b72, identifier: VH67145
2026-03-30 11:05:41 [auto1.es] INFO: Found listing with ID: ST19382
2026-03-30 11:05:41 [auto1.es] INFO: Found listing with ID: AR65980
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR65980%27 HTTP/1.1" 200 None
2026-03-30 11:05:42 [auto1.es] INFO: Scrape type for AR65980: 1
2026-03-30 11:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b29b3eba-8a51-53ef-b553-ab27a0047b72 with identifier: VH67145
2026-03-30 11:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b29b3eba-8a51-53ef-b553-ab27a0047b72 with identifier: VH67145
2026-03-30 11:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b29b3eba-8a51-53ef-b553-ab27a0047b72 with identifier: VH67145 to the API
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH67145>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:10:22Z',
 'fuel_type': 'diesel',
 'id': 'b29b3eba-8a51-53ef-b553-ab27a0047b72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH67145',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 54622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_5d2617d895b848da90f74316ef1cce28.jpg',
                'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_787a53c906b7fa9856543ae6b679d0c9.jpg',
                'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_37124e4b2d900b37503c5168bdf901b4.jpg',
                'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_3de316e110c7c6e15ac1adc9a595d955.jpg',
                'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_996d2460d7e19e007a25739ec8f14b6c.jpg',
                'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_879547a65666b9e9b1e60690a22358e8.jpg',
                'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_fbd2b0366124f74c2fe565ea79989b01.jpg',
                'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_c0b5f504c86efcbfbcb1a4f4ca47d1e1.jpg',
                'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_7871bb84ef336c0259bdbd8b36f685ef.jpg',
                'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_b01241f6a759d563d47c1e09a548d4cf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_5d2617d895b848da90f74316ef1cce28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_787a53c906b7fa9856543ae6b679d0c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_37124e4b2d900b37503c5168bdf901b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_3de316e110c7c6e15ac1adc9a595d955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_996d2460d7e19e007a25739ec8f14b6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_879547a65666b9e9b1e60690a22358e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_fbd2b0366124f74c2fe565ea79989b01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_c0b5f504c86efcbfbcb1a4f4ca47d1e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_7871bb84ef336c0259bdbd8b36f685ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29b3eba-8a51-53ef-b553-ab27a0047b72/b29b3eba-8a51-53ef-b553-ab27a0047b72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/3c/c03ccbeb098451eee02513c4480a4034/pa/VH67145_b01241f6a759d563d47c1e09a548d4cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2021}
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH67145%27 HTTP/1.1" 200 None
2026-03-30 11:05:42 [auto1.es] INFO: Saving data for VH67145: {'created_time': 1774868742.381881, 'last_price_update_time': 1774868742.381892, 'auction_closing_time': 1774969822.0}
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VH67145') HTTP/1.1" 204 0
2026-03-30 11:05:42 [auto1.es] INFO: Found listing with ID: LH72320
2026-03-30 11:05:42 [auto1.es] INFO: Found listing with ID: YJ93473
2026-03-30 11:05:42 [auto1.es] INFO: Found listing with ID: YZ56503
2026-03-30 11:05:42 [auto1.es] INFO: Found listing with ID: SJ54893
2026-03-30 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS41958> (referer: https://www.auto1.com/v1/car-details-view/WS41958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4168103f-7162-5299-8264-ce2b21be86cb with identifier: WS41958
2026-03-30 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4168103f-7162-5299-8264-ce2b21be86cb with scrape type 1
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_a77acf42a55a985c1a980ac8012e7d66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_a77acf42a55a985c1a980ac8012e7d66.jpg not downloaded yet
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_d383c2479e1b6d8955de26cc3d0db62b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_d383c2479e1b6d8955de26cc3d0db62b.jpg not downloaded yet
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_3335f3bf3674e4d9866421e7801051a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_3335f3bf3674e4d9866421e7801051a1.jpg not downloaded yet
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_6da2f4c443f1f2e42b67b504624d225b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_6da2f4c443f1f2e42b67b504624d225b.jpg not downloaded yet
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_fbac76c7445064c56511cafbba6eb30b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_fbac76c7445064c56511cafbba6eb30b.jpg not downloaded yet
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_c7f746213435ef17f81c8989444431cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_c7f746213435ef17f81c8989444431cd.jpg not downloaded yet
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_7099545f6cc87638e8339068d1c827f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_7099545f6cc87638e8339068d1c827f6.jpg not downloaded yet
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_ec0630a14c295885fcf5ba1a476719c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_ec0630a14c295885fcf5ba1a476719c0.jpg not downloaded yet
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_c95b802ed7cd34175a14bc1541863c24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_c95b802ed7cd34175a14bc1541863c24.jpg not downloaded yet
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_5d11ce5abe92a37a810420e2ef67fe50.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_5d11ce5abe92a37a810420e2ef67fe50.jpg not downloaded yet
2026-03-30 11:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK20362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC82421> (referer: https://www.auto1.com/v1/car-details-view/HC82421/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_5d11ce5abe92a37a810420e2ef67fe50.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49b08ccf-237e-5765-b302-a06829747070 with identifier: HC82421
2026-03-30 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49b08ccf-237e-5765-b302-a06829747070 with scrape type 1
2026-03-30 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49b08ccf-237e-5765-b302-a06829747070
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_4663c11ae89e3586ca6b94f21aad4817.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_4663c11ae89e3586ca6b94f21aad4817.jpg already downloaded
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_ad67a5fab47aef5c79cb7740a8309cfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_ad67a5fab47aef5c79cb7740a8309cfc.jpg already downloaded
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_0d9717a494c2e8b945ab0f28b19f2f2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_0d9717a494c2e8b945ab0f28b19f2f2e.jpg already downloaded
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_65c74431c4eb37a534953a3ad21eb8b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_65c74431c4eb37a534953a3ad21eb8b6.jpg already downloaded
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_d2942e6a23606897b4cd07c3858f6234.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_d2942e6a23606897b4cd07c3858f6234.jpg already downloaded
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_9150f385ee0198a2079bd05e8b05a5cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_9150f385ee0198a2079bd05e8b05a5cf.jpg already downloaded
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_bccb25d0e4e4c27d14f35b32a6213430.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_bccb25d0e4e4c27d14f35b32a6213430.jpg already downloaded
2026-03-30 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_3c251fa5d89252fd809593a205ac96e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_3c251fa5d89252fd809593a205ac96e6.jpg already downloaded
2026-03-30 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_2cc399dba52e840b97061dc9f2716533.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_2cc399dba52e840b97061dc9f2716533.jpg already downloaded
2026-03-30 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F95%252Fe3954263e0bdc4101410fce2ba751cfb%252Fpa%252FHC82421_8f69a8503e694122de26100f846f1dd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_8f69a8503e694122de26100f846f1dd6.jpg already downloaded
2026-03-30 11:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49b08ccf-237e-5765-b302-a06829747070, identifier: HC82421
2026-03-30 11:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49b08ccf-237e-5765-b302-a06829747070 with identifier: HC82421
2026-03-30 11:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49b08ccf-237e-5765-b302-a06829747070 with identifier: HC82421
2026-03-30 11:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49b08ccf-237e-5765-b302-a06829747070 with identifier: HC82421 to the API
2026-03-30 11:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HC82421>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:35:59Z',
 'fuel_type': 'diesel',
 'id': '49b08ccf-237e-5765-b302-a06829747070',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC82421',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 250234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_4663c11ae89e3586ca6b94f21aad4817.jpg',
                'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_ad67a5fab47aef5c79cb7740a8309cfc.jpg',
                'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_0d9717a494c2e8b945ab0f28b19f2f2e.jpg',
                'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_65c74431c4eb37a534953a3ad21eb8b6.jpg',
                'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_d2942e6a23606897b4cd07c3858f6234.jpg',
                'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_9150f385ee0198a2079bd05e8b05a5cf.jpg',
                'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_bccb25d0e4e4c27d14f35b32a6213430.jpg',
                'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_3c251fa5d89252fd809593a205ac96e6.jpg',
                'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_2cc399dba52e840b97061dc9f2716533.jpg',
                'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_8f69a8503e694122de26100f846f1dd6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_4663c11ae89e3586ca6b94f21aad4817.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_ad67a5fab47aef5c79cb7740a8309cfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_0d9717a494c2e8b945ab0f28b19f2f2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_65c74431c4eb37a534953a3ad21eb8b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_d2942e6a23606897b4cd07c3858f6234.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_9150f385ee0198a2079bd05e8b05a5cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_bccb25d0e4e4c27d14f35b32a6213430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_3c251fa5d89252fd809593a205ac96e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_2cc399dba52e840b97061dc9f2716533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b08ccf-237e-5765-b302-a06829747070/49b08ccf-237e-5765-b302-a06829747070_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/95/e3954263e0bdc4101410fce2ba751cfb/pa/HC82421_8f69a8503e694122de26100f846f1dd6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2014}
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC82421%27 HTTP/1.1" 200 None
2026-03-30 11:05:51 [auto1.es] INFO: Saving data for HC82421: {'created_time': 1774868751.353785, 'last_price_update_time': 1774868751.353795, 'auction_closing_time': 1774971359.0}
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HC82421') HTTP/1.1" 204 0
2026-03-30 11:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_c95b802ed7cd34175a14bc1541863c24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd3e0810>
2026-03-30 11:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_5d11ce5abe92a37a810420e2ef67fe50.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_5d11ce5abe92a37a810420e2ef67fe50.jpg saved to cache
2026-03-30 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c2190>
2026-03-30 11:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_c95b802ed7cd34175a14bc1541863c24.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_c95b802ed7cd34175a14bc1541863c24.jpg saved to cache
2026-03-30 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_7099545f6cc87638e8339068d1c827f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:51 [auto1.es] INFO: Channel: 24h | Page: 8 | totalHits: 2195 | hits on page: 40
2026-03-30 11:05:51 [auto1.es] INFO: Found listing with ID: ZA20245
2026-03-30 11:05:51 [auto1.es] INFO: Found listing with ID: SV24674
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV24674%27 HTTP/1.1" 200 None
2026-03-30 11:05:51 [auto1.es] INFO: Scrape type for SV24674: 1
2026-03-30 11:05:51 [auto1.es] INFO: Found listing with ID: YP48986
2026-03-30 11:05:51 [auto1.es] INFO: Found listing with ID: KU70052
2026-03-30 11:05:51 [auto1.es] INFO: Found listing with ID: VL95678
2026-03-30 11:05:51 [auto1.es] INFO: Found listing with ID: DC03614
2026-03-30 11:05:51 [auto1.es] INFO: Found listing with ID: DJ81292
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ81292%27 HTTP/1.1" 200 None
2026-03-30 11:05:51 [auto1.es] INFO: Scrape type for DJ81292: 2
2026-03-30 11:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bccd9510-c7d2-5072-bb13-af91ceb18390 with identifier: DJ81292
2026-03-30 11:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bccd9510-c7d2-5072-bb13-af91ceb18390 with scrape type 2
2026-03-30 11:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bccd9510-c7d2-5072-bb13-af91ceb18390 with scrape type 2
2026-03-30 11:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bccd9510-c7d2-5072-bb13-af91ceb18390, identifier: DJ81292
2026-03-30 11:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bccd9510-c7d2-5072-bb13-af91ceb18390 with identifier: DJ81292
2026-03-30 11:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bccd9510-c7d2-5072-bb13-af91ceb18390 with identifier: DJ81292
2026-03-30 11:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bccd9510-c7d2-5072-bb13-af91ceb18390 with identifier: DJ81292 to the API
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:35:09Z',
 'fuel_type': 'diesel',
 'id': 'bccd9510-c7d2-5072-bb13-af91ceb18390',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ81292',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 232223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ81292%27 HTTP/1.1" 200 None
2026-03-30 11:05:52 [auto1.es] INFO: Saving data for DJ81292: {'auction_closing_time': 1774971309.0, 'created_time': 1773659870.246262, 'last_price_update_time': 1774868752.043555}
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DJ81292') HTTP/1.1" 204 0
2026-03-30 11:05:52 [auto1.es] INFO: Found listing with ID: ZK75464
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK75464%27 HTTP/1.1" 200 None
2026-03-30 11:05:52 [auto1.es] INFO: Scrape type for ZK75464: 1
2026-03-30 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_c7f746213435ef17f81c8989444431cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_ec0630a14c295885fcf5ba1a476719c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6563b90>
2026-03-30 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_7099545f6cc87638e8339068d1c827f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_7099545f6cc87638e8339068d1c827f6.jpg saved to cache
2026-03-30 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:05:52 [auto1.es] INFO: Found listing with ID: TD39535
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD39535%27 HTTP/1.1" 200 None
2026-03-30 11:05:52 [auto1.es] INFO: Scrape type for TD39535: 2
2026-03-30 11:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c916a85b-0cb4-518e-8ee4-719f67eb81ef with identifier: TD39535
2026-03-30 11:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c916a85b-0cb4-518e-8ee4-719f67eb81ef with scrape type 2
2026-03-30 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c916a85b-0cb4-518e-8ee4-719f67eb81ef with scrape type 2
2026-03-30 11:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c916a85b-0cb4-518e-8ee4-719f67eb81ef, identifier: TD39535
2026-03-30 11:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c916a85b-0cb4-518e-8ee4-719f67eb81ef with identifier: TD39535
2026-03-30 11:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c916a85b-0cb4-518e-8ee4-719f67eb81ef with identifier: TD39535
2026-03-30 11:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c916a85b-0cb4-518e-8ee4-719f67eb81ef with identifier: TD39535 to the API
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:34:02Z',
 'fuel_type': 'diesel',
 'id': 'c916a85b-0cb4-518e-8ee4-719f67eb81ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD39535',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 147959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2013}
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD39535%27 HTTP/1.1" 200 None
2026-03-30 11:05:52 [auto1.es] INFO: Saving data for TD39535: {'auction_closing_time': 1774971242.0, 'created_time': 1773900249.974197, 'last_price_update_time': 1774868752.646052}
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TD39535') HTTP/1.1" 204 0
2026-03-30 11:05:52 [auto1.es] INFO: Found listing with ID: ZR84162
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR84162%27 HTTP/1.1" 200 None
2026-03-30 11:05:52 [auto1.es] INFO: Scrape type for ZR84162: 2
2026-03-30 11:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24034835-59bc-520f-a412-4ba51f4aa468 with identifier: ZR84162
2026-03-30 11:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24034835-59bc-520f-a412-4ba51f4aa468 with scrape type 2
2026-03-30 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24034835-59bc-520f-a412-4ba51f4aa468 with scrape type 2
2026-03-30 11:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24034835-59bc-520f-a412-4ba51f4aa468, identifier: ZR84162
2026-03-30 11:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24034835-59bc-520f-a412-4ba51f4aa468 with identifier: ZR84162
2026-03-30 11:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24034835-59bc-520f-a412-4ba51f4aa468 with identifier: ZR84162
2026-03-30 11:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24034835-59bc-520f-a412-4ba51f4aa468 with identifier: ZR84162 to the API
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:09Z',
 'fuel_type': 'diesel',
 'id': '24034835-59bc-520f-a412-4ba51f4aa468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR84162',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 251021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-17',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 HDi Sport Pack',
 'transmission': 'manual',
 'trim': 'Sport Pack',
 'year': 2011}
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR84162%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.es] INFO: Saving data for ZR84162: {'auction_closing_time': 1774970109.0, 'created_time': 1773900240.400958, 'last_price_update_time': 1774868753.105196}
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZR84162') HTTP/1.1" 204 0
2026-03-30 11:05:53 [auto1.es] INFO: Found listing with ID: TR12651
2026-03-30 11:05:53 [auto1.es] INFO: Found listing with ID: JH23969
2026-03-30 11:05:53 [auto1.es] INFO: Found listing with ID: SN94812
2026-03-30 11:05:53 [auto1.es] INFO: Found listing with ID: LV69921
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV69921%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.es] INFO: Scrape type for LV69921: 2
2026-03-30 11:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd9dd7a5-a96b-5152-8c91-899363425f70 with identifier: LV69921
2026-03-30 11:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd9dd7a5-a96b-5152-8c91-899363425f70 with scrape type 2
2026-03-30 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd9dd7a5-a96b-5152-8c91-899363425f70 with scrape type 2
2026-03-30 11:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cd9dd7a5-a96b-5152-8c91-899363425f70, identifier: LV69921
2026-03-30 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f1b210>
2026-03-30 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_c7f746213435ef17f81c8989444431cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_c7f746213435ef17f81c8989444431cd.jpg saved to cache
2026-03-30 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6555090>
2026-03-30 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_ec0630a14c295885fcf5ba1a476719c0.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_ec0630a14c295885fcf5ba1a476719c0.jpg saved to cache
2026-03-30 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cd9dd7a5-a96b-5152-8c91-899363425f70 with identifier: LV69921
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 11:05:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cd9dd7a5-a96b-5152-8c91-899363425f70 with identifier: LV69921
2026-03-30 11:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cd9dd7a5-a96b-5152-8c91-899363425f70 with identifier: LV69921 to the API
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:56:46Z',
 'fuel_type': 'diesel',
 'id': 'cd9dd7a5-a96b-5152-8c91-899363425f70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV69921',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 79908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 114 CDI lang Pro',
 'transmission': 'automatic',
 'trim': 'lang Pro',
 'year': 2019}
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV69921%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.es] INFO: Saving data for LV69921: {'auction_closing_time': 1774972606.0, 'created_time': 1773659710.548271, 'last_price_update_time': 1774868754.051112}
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LV69921') HTTP/1.1" 204 0
2026-03-30 11:05:54 [auto1.es] INFO: Found listing with ID: VH11492
2026-03-30 11:05:54 [auto1.es] INFO: Found listing with ID: RK33204
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK33204%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.es] INFO: Scrape type for RK33204: 2
2026-03-30 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5824e8d9-4248-5815-b620-96d31103224b with identifier: RK33204
2026-03-30 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5824e8d9-4248-5815-b620-96d31103224b with scrape type 2
2026-03-30 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5824e8d9-4248-5815-b620-96d31103224b with scrape type 2
2026-03-30 11:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5824e8d9-4248-5815-b620-96d31103224b, identifier: RK33204
2026-03-30 11:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5824e8d9-4248-5815-b620-96d31103224b with identifier: RK33204
2026-03-30 11:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5824e8d9-4248-5815-b620-96d31103224b with identifier: RK33204
2026-03-30 11:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5824e8d9-4248-5815-b620-96d31103224b with identifier: RK33204 to the API
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:23:35Z',
 'fuel_type': 'petrol',
 'id': '5824e8d9-4248-5815-b620-96d31103224b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK33204',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 208360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-08',
 'seller_name': None,
 'title': 'Citroen DS5 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2012}
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK33204%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.es] INFO: Saving data for RK33204: {'auction_closing_time': 1774970615.0, 'created_time': 1774436529.743218, 'last_price_update_time': 1774868754.512471}
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK33204') HTTP/1.1" 204 0
2026-03-30 11:05:54 [auto1.es] INFO: Found listing with ID: MF04433
2026-03-30 11:05:54 [auto1.es] INFO: Found listing with ID: CW24130
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW24130%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.es] INFO: Scrape type for CW24130: 1
2026-03-30 11:05:54 [auto1.es] INFO: Found listing with ID: YG81758
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG81758%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.es] INFO: Scrape type for YG81758: 2
2026-03-30 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 677c5087-f2d6-5cb2-98ed-f57e39e217a0 with identifier: YG81758
2026-03-30 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 677c5087-f2d6-5cb2-98ed-f57e39e217a0 with scrape type 2
2026-03-30 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 677c5087-f2d6-5cb2-98ed-f57e39e217a0 with scrape type 2
2026-03-30 11:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 677c5087-f2d6-5cb2-98ed-f57e39e217a0, identifier: YG81758
2026-03-30 11:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 677c5087-f2d6-5cb2-98ed-f57e39e217a0 with identifier: YG81758
2026-03-30 11:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 677c5087-f2d6-5cb2-98ed-f57e39e217a0 with identifier: YG81758
2026-03-30 11:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 677c5087-f2d6-5cb2-98ed-f57e39e217a0 with identifier: YG81758 to the API
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:23:47Z',
 'fuel_type': 'diesel',
 'id': '677c5087-f2d6-5cb2-98ed-f57e39e217a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG81758',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 323649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-04-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2002}
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG81758%27 HTTP/1.1" 200 None
2026-03-30 11:05:55 [auto1.es] INFO: Saving data for YG81758: {'auction_closing_time': 1774970627.0, 'created_time': 1774436504.041156, 'last_price_update_time': 1774868755.008406}
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YG81758') HTTP/1.1" 204 0
2026-03-30 11:05:55 [auto1.es] INFO: Found listing with ID: PV35004
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV35004%27 HTTP/1.1" 200 None
2026-03-30 11:05:55 [auto1.es] INFO: Scrape type for PV35004: 1
2026-03-30 11:05:55 [auto1.es] INFO: Found listing with ID: SB83788
2026-03-30 11:05:55 [auto1.es] INFO: Found listing with ID: NW30144
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW30144%27 HTTP/1.1" 200 None
2026-03-30 11:05:55 [auto1.es] INFO: Scrape type for NW30144: 2
2026-03-30 11:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29f78af8-147c-5390-b1d0-fa94ed978572 with identifier: NW30144
2026-03-30 11:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f78af8-147c-5390-b1d0-fa94ed978572 with scrape type 2
2026-03-30 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29f78af8-147c-5390-b1d0-fa94ed978572 with scrape type 2
2026-03-30 11:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29f78af8-147c-5390-b1d0-fa94ed978572, identifier: NW30144
2026-03-30 11:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT70526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29f78af8-147c-5390-b1d0-fa94ed978572 with identifier: NW30144
2026-03-30 11:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29f78af8-147c-5390-b1d0-fa94ed978572 with identifier: NW30144
2026-03-30 11:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29f78af8-147c-5390-b1d0-fa94ed978572 with identifier: NW30144 to the API
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:03:01Z',
 'fuel_type': 'petrol',
 'id': '29f78af8-147c-5390-b1d0-fa94ed978572',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW30144',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 189366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-01',
 'seller_name': None,
 'title': 'Toyota RAV 4 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW30144%27 HTTP/1.1" 200 None
2026-03-30 11:05:55 [auto1.es] INFO: Saving data for NW30144: {'auction_closing_time': 1774969381.0, 'created_time': 1773227752.812538, 'last_price_update_time': 1774868755.57}
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NW30144') HTTP/1.1" 204 0
2026-03-30 11:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:55 [auto1.es] INFO: Found listing with ID: UT90004
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT90004%27 HTTP/1.1" 200 None
2026-03-30 11:05:55 [auto1.es] INFO: Scrape type for UT90004: 2
2026-03-30 11:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with identifier: UT90004
2026-03-30 11:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with scrape type 2
2026-03-30 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with scrape type 2
2026-03-30 11:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ef7c017-80d9-5808-a56b-bfc1db8f8607, identifier: UT90004
2026-03-30 11:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with identifier: UT90004
2026-03-30 11:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with identifier: UT90004
2026-03-30 11:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with identifier: UT90004 to the API
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:17:40Z',
 'fuel_type': 'petrol',
 'id': '5ef7c017-80d9-5808-a56b-bfc1db8f8607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT90004',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 163157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-27',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT90004%27 HTTP/1.1" 200 None
2026-03-30 11:05:56 [auto1.es] INFO: Saving data for UT90004: {'auction_closing_time': 1774970260.0, 'created_time': 1774296045.475732, 'last_price_update_time': 1774868756.017495}
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT90004') HTTP/1.1" 204 0
2026-03-30 11:05:56 [auto1.es] INFO: Found listing with ID: NE81448
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE81448%27 HTTP/1.1" 200 None
2026-03-30 11:05:56 [auto1.es] INFO: Scrape type for NE81448: 2
2026-03-30 11:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24963be-b3e9-5cb5-be60-30058ff6651f with identifier: NE81448
2026-03-30 11:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24963be-b3e9-5cb5-be60-30058ff6651f with scrape type 2
2026-03-30 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24963be-b3e9-5cb5-be60-30058ff6651f with scrape type 2
2026-03-30 11:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c24963be-b3e9-5cb5-be60-30058ff6651f, identifier: NE81448
2026-03-30 11:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c24963be-b3e9-5cb5-be60-30058ff6651f with identifier: NE81448
2026-03-30 11:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c24963be-b3e9-5cb5-be60-30058ff6651f with identifier: NE81448
2026-03-30 11:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c24963be-b3e9-5cb5-be60-30058ff6651f with identifier: NE81448 to the API
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:07:24Z',
 'fuel_type': 'petrol',
 'id': 'c24963be-b3e9-5cb5-be60-30058ff6651f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE81448',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 283157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-03',
 'seller_name': None,
 'title': 'Hyundai i30 1.0 TGDI Klass',
 'transmission': 'manual',
 'trim': 'Klass',
 'year': 2019}
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE81448%27 HTTP/1.1" 200 None
2026-03-30 11:05:56 [auto1.es] INFO: Saving data for NE81448: {'auction_closing_time': 1774969644.0, 'created_time': 1773691372.065503, 'last_price_update_time': 1774868756.550194}
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NE81448') HTTP/1.1" 204 0
2026-03-30 11:05:56 [auto1.es] INFO: Found listing with ID: BK85695
2026-03-30 11:05:56 [auto1.es] INFO: Found listing with ID: GZ30272
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ30272%27 HTTP/1.1" 200 None
2026-03-30 11:05:56 [auto1.es] INFO: Scrape type for GZ30272: 1
2026-03-30 11:05:56 [auto1.es] INFO: Found listing with ID: NF79265
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF79265%27 HTTP/1.1" 200 None
2026-03-30 11:05:56 [auto1.es] INFO: Scrape type for NF79265: 2
2026-03-30 11:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f282cd6c-5dda-5a1d-ab14-86f59f56835a with identifier: NF79265
2026-03-30 11:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f282cd6c-5dda-5a1d-ab14-86f59f56835a with scrape type 2
2026-03-30 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f282cd6c-5dda-5a1d-ab14-86f59f56835a with scrape type 2
2026-03-30 11:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f282cd6c-5dda-5a1d-ab14-86f59f56835a, identifier: NF79265
2026-03-30 11:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f282cd6c-5dda-5a1d-ab14-86f59f56835a with identifier: NF79265
2026-03-30 11:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f282cd6c-5dda-5a1d-ab14-86f59f56835a with identifier: NF79265
2026-03-30 11:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f282cd6c-5dda-5a1d-ab14-86f59f56835a with identifier: NF79265 to the API
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:08:40Z',
 'fuel_type': 'diesel',
 'id': 'f282cd6c-5dda-5a1d-ab14-86f59f56835a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF79265',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 93615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'automatic',
 'trim': 'Allure L1',
 'year': 2019}
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF79265%27 HTTP/1.1" 200 None
2026-03-30 11:05:57 [auto1.es] INFO: Saving data for NF79265: {'auction_closing_time': 1774969720.0, 'created_time': 1773131343.510691, 'last_price_update_time': 1774868757.064111}
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NF79265') HTTP/1.1" 204 0
2026-03-30 11:05:57 [auto1.es] INFO: Found listing with ID: RJ04030
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ04030%27 HTTP/1.1" 200 None
2026-03-30 11:05:57 [auto1.es] INFO: Scrape type for RJ04030: 2
2026-03-30 11:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 819283a6-e912-5eac-bcf1-017a1ddf46b5 with identifier: RJ04030
2026-03-30 11:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819283a6-e912-5eac-bcf1-017a1ddf46b5 with scrape type 2
2026-03-30 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 819283a6-e912-5eac-bcf1-017a1ddf46b5 with scrape type 2
2026-03-30 11:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 819283a6-e912-5eac-bcf1-017a1ddf46b5, identifier: RJ04030
2026-03-30 11:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 819283a6-e912-5eac-bcf1-017a1ddf46b5 with identifier: RJ04030
2026-03-30 11:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 819283a6-e912-5eac-bcf1-017a1ddf46b5 with identifier: RJ04030
2026-03-30 11:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 819283a6-e912-5eac-bcf1-017a1ddf46b5 with identifier: RJ04030 to the API
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:12:09Z',
 'fuel_type': 'petrol',
 'id': '819283a6-e912-5eac-bcf1-017a1ddf46b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ04030',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 229696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-29',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ04030%27 HTTP/1.1" 200 None
2026-03-30 11:05:57 [auto1.es] INFO: Saving data for RJ04030: {'auction_closing_time': 1774969929.0, 'created_time': 1773133786.010381, 'last_price_update_time': 1774868757.904777}
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RJ04030') HTTP/1.1" 204 0
2026-03-30 11:05:57 [auto1.es] INFO: Found listing with ID: PG52964
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG52964%27 HTTP/1.1" 200 None
2026-03-30 11:05:57 [auto1.es] INFO: Scrape type for PG52964: 2
2026-03-30 11:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c9c507d-21e6-506c-87cf-724649fed202 with identifier: PG52964
2026-03-30 11:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c9c507d-21e6-506c-87cf-724649fed202 with scrape type 2
2026-03-30 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c9c507d-21e6-506c-87cf-724649fed202 with scrape type 2
2026-03-30 11:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c9c507d-21e6-506c-87cf-724649fed202, identifier: PG52964
2026-03-30 11:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c9c507d-21e6-506c-87cf-724649fed202 with identifier: PG52964
2026-03-30 11:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c9c507d-21e6-506c-87cf-724649fed202 with identifier: PG52964
2026-03-30 11:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c9c507d-21e6-506c-87cf-724649fed202 with identifier: PG52964 to the API
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:27Z',
 'fuel_type': 'diesel',
 'id': '4c9c507d-21e6-506c-87cf-724649fed202',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG52964',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 161494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-20',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG52964%27 HTTP/1.1" 200 None
2026-03-30 11:05:58 [auto1.es] INFO: Saving data for PG52964: {'auction_closing_time': 1774969707.0, 'created_time': 1774263672.010366, 'last_price_update_time': 1774868758.375764}
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PG52964') HTTP/1.1" 204 0
2026-03-30 11:05:58 [auto1.es] INFO: Found listing with ID: YM64147
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM64147%27 HTTP/1.1" 200 None
2026-03-30 11:05:58 [auto1.es] INFO: Scrape type for YM64147: 1
2026-03-30 11:05:58 [auto1.es] INFO: Found listing with ID: XA84962
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA84962%27 HTTP/1.1" 200 None
2026-03-30 11:05:58 [auto1.es] INFO: Scrape type for XA84962: 2
2026-03-30 11:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a941030-7565-5cef-ac28-8cb00cb36d46 with identifier: XA84962
2026-03-30 11:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a941030-7565-5cef-ac28-8cb00cb36d46 with scrape type 2
2026-03-30 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a941030-7565-5cef-ac28-8cb00cb36d46 with scrape type 2
2026-03-30 11:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a941030-7565-5cef-ac28-8cb00cb36d46, identifier: XA84962
2026-03-30 11:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a941030-7565-5cef-ac28-8cb00cb36d46 with identifier: XA84962
2026-03-30 11:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a941030-7565-5cef-ac28-8cb00cb36d46 with identifier: XA84962
2026-03-30 11:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8a941030-7565-5cef-ac28-8cb00cb36d46 with identifier: XA84962 to the API
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:32:10Z',
 'fuel_type': 'diesel',
 'id': '8a941030-7565-5cef-ac28-8cb00cb36d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA84962',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 184865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-29',
 'seller_name': None,
 'title': 'Volvo C30 2.0 D Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA84962%27 HTTP/1.1" 200 None
2026-03-30 11:05:58 [auto1.es] INFO: Saving data for XA84962: {'auction_closing_time': 1774971130.0, 'created_time': 1773131104.254432, 'last_price_update_time': 1774868758.870195}
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XA84962') HTTP/1.1" 204 0
2026-03-30 11:05:58 [auto1.es] INFO: Found listing with ID: XX24085
2026-03-30 11:05:58 [auto1.es] INFO: Found listing with ID: BV86161
2026-03-30 11:05:58 [auto1.es] INFO: Found listing with ID: WX23682
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX23682%27 HTTP/1.1" 200 None
2026-03-30 11:05:59 [auto1.es] INFO: Scrape type for WX23682: 2
2026-03-30 11:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edf4739a-6a05-5432-83f9-da8bd4f09035 with identifier: WX23682
2026-03-30 11:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edf4739a-6a05-5432-83f9-da8bd4f09035 with scrape type 2
2026-03-30 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edf4739a-6a05-5432-83f9-da8bd4f09035 with scrape type 2
2026-03-30 11:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: edf4739a-6a05-5432-83f9-da8bd4f09035, identifier: WX23682
2026-03-30 11:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: edf4739a-6a05-5432-83f9-da8bd4f09035 with identifier: WX23682
2026-03-30 11:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: edf4739a-6a05-5432-83f9-da8bd4f09035 with identifier: WX23682
2026-03-30 11:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: edf4739a-6a05-5432-83f9-da8bd4f09035 with identifier: WX23682 to the API
2026-03-30 11:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:54:50Z',
 'fuel_type': 'diesel',
 'id': 'edf4739a-6a05-5432-83f9-da8bd4f09035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX23682',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 228277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX23682%27 HTTP/1.1" 200 None
2026-03-30 11:06:00 [auto1.es] INFO: Saving data for WX23682: {'auction_closing_time': 1774972490.0, 'created_time': 1774296098.895113, 'last_price_update_time': 1774868760.150913}
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WX23682') HTTP/1.1" 204 0
2026-03-30 11:06:00 [auto1.es] INFO: Found listing with ID: RN47557
2026-03-30 11:06:00 [auto1.es] INFO: Found listing with ID: WM40400
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM40400%27 HTTP/1.1" 200 None
2026-03-30 11:06:00 [auto1.es] INFO: Scrape type for WM40400: 2
2026-03-30 11:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9256e5e-ac5d-52bd-93c3-ac14c22b6eec with identifier: WM40400
2026-03-30 11:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9256e5e-ac5d-52bd-93c3-ac14c22b6eec with scrape type 2
2026-03-30 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9256e5e-ac5d-52bd-93c3-ac14c22b6eec with scrape type 2
2026-03-30 11:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9256e5e-ac5d-52bd-93c3-ac14c22b6eec, identifier: WM40400
2026-03-30 11:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9256e5e-ac5d-52bd-93c3-ac14c22b6eec with identifier: WM40400
2026-03-30 11:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9256e5e-ac5d-52bd-93c3-ac14c22b6eec with identifier: WM40400
2026-03-30 11:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9256e5e-ac5d-52bd-93c3-ac14c22b6eec with identifier: WM40400 to the API
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:16:36Z',
 'fuel_type': 'diesel',
 'id': 'a9256e5e-ac5d-52bd-93c3-ac14c22b6eec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM40400',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 145331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-20',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM40400%27 HTTP/1.1" 200 None
2026-03-30 11:06:00 [auto1.es] INFO: Saving data for WM40400: {'auction_closing_time': 1774970196.0, 'created_time': 1773238649.941267, 'last_price_update_time': 1774868760.603126}
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WM40400') HTTP/1.1" 204 0
2026-03-30 11:06:00 [auto1.es] INFO: Found listing with ID: TU76767
2026-03-30 11:06:00 [auto1.es] INFO: Found listing with ID: RK47874
2026-03-30 11:06:00 [auto1.es] INFO: Found listing with ID: LA75479
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA75479%27 HTTP/1.1" 200 None
2026-03-30 11:06:00 [auto1.es] INFO: Scrape type for LA75479: 2
2026-03-30 11:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f829b6c-58ec-5247-9395-64ffcea01911 with identifier: LA75479
2026-03-30 11:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f829b6c-58ec-5247-9395-64ffcea01911 with scrape type 2
2026-03-30 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f829b6c-58ec-5247-9395-64ffcea01911 with scrape type 2
2026-03-30 11:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f829b6c-58ec-5247-9395-64ffcea01911, identifier: LA75479
2026-03-30 11:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f829b6c-58ec-5247-9395-64ffcea01911 with identifier: LA75479
2026-03-30 11:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f829b6c-58ec-5247-9395-64ffcea01911 with identifier: LA75479
2026-03-30 11:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f829b6c-58ec-5247-9395-64ffcea01911 with identifier: LA75479 to the API
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:21:25Z',
 'fuel_type': 'petrol',
 'id': '6f829b6c-58ec-5247-9395-64ffcea01911',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA75479',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 226724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-15',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2010}
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA75479%27 HTTP/1.1" 200 None
2026-03-30 11:06:01 [auto1.es] INFO: Saving data for LA75479: {'auction_closing_time': 1774970485.0, 'created_time': 1773659714.915668, 'last_price_update_time': 1774868761.060554}
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LA75479') HTTP/1.1" 204 0
2026-03-30 11:06:01 [auto1.es] INFO: Found listing with ID: UX44517
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX44517%27 HTTP/1.1" 200 None
2026-03-30 11:06:01 [auto1.es] INFO: Scrape type for UX44517: 2
2026-03-30 11:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61fb1744-4f13-5dfa-ac2b-c9f7f5ed94ec with identifier: UX44517
2026-03-30 11:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61fb1744-4f13-5dfa-ac2b-c9f7f5ed94ec with scrape type 2
2026-03-30 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61fb1744-4f13-5dfa-ac2b-c9f7f5ed94ec with scrape type 2
2026-03-30 11:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 61fb1744-4f13-5dfa-ac2b-c9f7f5ed94ec, identifier: UX44517
2026-03-30 11:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 61fb1744-4f13-5dfa-ac2b-c9f7f5ed94ec with identifier: UX44517
2026-03-30 11:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 61fb1744-4f13-5dfa-ac2b-c9f7f5ed94ec with identifier: UX44517
2026-03-30 11:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 61fb1744-4f13-5dfa-ac2b-c9f7f5ed94ec with identifier: UX44517 to the API
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:47:19Z',
 'fuel_type': 'diesel',
 'id': '61fb1744-4f13-5dfa-ac2b-c9f7f5ed94ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX44517',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 141044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-26',
 'seller_name': None,
 'title': 'Kia Venga 1.4 CRDi Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2010}
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX44517%27 HTTP/1.1" 200 None
2026-03-30 11:06:01 [auto1.es] INFO: Saving data for UX44517: {'auction_closing_time': 1774972039.0, 'created_time': 1774036986.243269, 'last_price_update_time': 1774868761.55282}
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UX44517') HTTP/1.1" 204 0
2026-03-30 11:06:04 [scrapy.extensions.logstats] INFO: Crawled 84 pages (at 19 pages/min), scraped 133 items (at 45 items/min)
2026-03-30 11:06:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS18860> (referer: https://www.auto1.com/v1/car-details-view/CS18860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d48c4d5b-a8ba-5406-a5ce-183f2835debd with identifier: CS18860
2026-03-30 11:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d48c4d5b-a8ba-5406-a5ce-183f2835debd with scrape type 1
2026-03-30 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_421831066431b861b53bf1098d1d7962.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_421831066431b861b53bf1098d1d7962.jpg not downloaded yet
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_6904d599e42b3a34c6bfe60ff84ed6ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_6904d599e42b3a34c6bfe60ff84ed6ff.jpg not downloaded yet
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_7f9b9a0a8c3e1281953cee17cbad3968.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_7f9b9a0a8c3e1281953cee17cbad3968.jpg not downloaded yet
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_72dab720e956b7f31cefdf1b43207ce9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_72dab720e956b7f31cefdf1b43207ce9.jpg not downloaded yet
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_61e176d17b6bae70a9e70d9abb6e9b1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_61e176d17b6bae70a9e70d9abb6e9b1d.jpg not downloaded yet
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_48380e07bec3ed952bc5d4b485cb37ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_48380e07bec3ed952bc5d4b485cb37ac.jpg not downloaded yet
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_07517fb3ff2ceefd7853e612a517b5f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_07517fb3ff2ceefd7853e612a517b5f4.jpg not downloaded yet
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_bb88603531618b8271868835b4c61ad9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_bb88603531618b8271868835b4c61ad9.jpg not downloaded yet
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_2ce0ca270c21685f26791cc7cb64ac33.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_2ce0ca270c21685f26791cc7cb64ac33.jpg not downloaded yet
2026-03-30 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_13a75fe9acd257929a373774f3e75e9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_13a75fe9acd257929a373774f3e75e9e.jpg not downloaded yet
2026-03-30 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN25328> (referer: https://www.auto1.com/v1/car-details-view/CN25328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c838140-d205-5ad8-8e12-54aa0e29ab4c with identifier: CN25328
2026-03-30 11:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c838140-d205-5ad8-8e12-54aa0e29ab4c with scrape type 1
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c838140-d205-5ad8-8e12-54aa0e29ab4c
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_87821b45ce93c527d184d60442f2c150.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_87821b45ce93c527d184d60442f2c150.jpg already downloaded
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_9f6cc9d0987e8013c8b68de05b7b0d47.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_9f6cc9d0987e8013c8b68de05b7b0d47.jpg already downloaded
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_2ccdc73f1039a86469631f24cf9c4954.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_2ccdc73f1039a86469631f24cf9c4954.jpg already downloaded
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_d6ae74d14f13e9c563490d2039aec756.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_d6ae74d14f13e9c563490d2039aec756.jpg already downloaded
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_d4a13110f516d8e80f223206ae2c68ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_d4a13110f516d8e80f223206ae2c68ce.jpg already downloaded
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_e20e2a9d6fcd7b03bce95fc14de2a452.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_e20e2a9d6fcd7b03bce95fc14de2a452.jpg already downloaded
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_29a6016e82a8bd228644554fe534014f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_29a6016e82a8bd228644554fe534014f.jpg already downloaded
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_157002566bdc882f8d975d96ce0c3b23.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_157002566bdc882f8d975d96ce0c3b23.jpg already downloaded
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_9a09014e21343eecd08f5fcacc7b74c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_9a09014e21343eecd08f5fcacc7b74c0.jpg already downloaded
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fff%252F67ff6e5a244d6f10faf6b42d908017c8%252Fpa%252FCN25328_7eb961e363d85d2f4c6bd11f5528a826.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_7eb961e363d85d2f4c6bd11f5528a826.jpg already downloaded
2026-03-30 11:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6c838140-d205-5ad8-8e12-54aa0e29ab4c, identifier: CN25328
2026-03-30 11:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6c838140-d205-5ad8-8e12-54aa0e29ab4c with identifier: CN25328
2026-03-30 11:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6c838140-d205-5ad8-8e12-54aa0e29ab4c with identifier: CN25328
2026-03-30 11:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6c838140-d205-5ad8-8e12-54aa0e29ab4c with identifier: CN25328 to the API
2026-03-30 11:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN25328>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 141,
 'expiration_date': '2026-03-31T15:37:46Z',
 'fuel_type': 'hybrid',
 'id': '6c838140-d205-5ad8-8e12-54aa0e29ab4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN25328',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 201293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_87821b45ce93c527d184d60442f2c150.jpg',
                'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_9f6cc9d0987e8013c8b68de05b7b0d47.jpg',
                'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_2ccdc73f1039a86469631f24cf9c4954.jpg',
                'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_d6ae74d14f13e9c563490d2039aec756.jpg',
                'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_d4a13110f516d8e80f223206ae2c68ce.jpg',
                'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_e20e2a9d6fcd7b03bce95fc14de2a452.jpg',
                'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_29a6016e82a8bd228644554fe534014f.jpg',
                'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_157002566bdc882f8d975d96ce0c3b23.jpg',
                'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_9a09014e21343eecd08f5fcacc7b74c0.jpg',
                'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_7eb961e363d85d2f4c6bd11f5528a826.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_87821b45ce93c527d184d60442f2c150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_9f6cc9d0987e8013c8b68de05b7b0d47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_2ccdc73f1039a86469631f24cf9c4954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_d6ae74d14f13e9c563490d2039aec756.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_d4a13110f516d8e80f223206ae2c68ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_e20e2a9d6fcd7b03bce95fc14de2a452.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_29a6016e82a8bd228644554fe534014f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_157002566bdc882f8d975d96ce0c3b23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_9a09014e21343eecd08f5fcacc7b74c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c838140-d205-5ad8-8e12-54aa0e29ab4c/6c838140-d205-5ad8-8e12-54aa0e29ab4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ff/67ff6e5a244d6f10faf6b42d908017c8/pa/CN25328_7eb961e363d85d2f4c6bd11f5528a826.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Niro 1.6 Plug-in Hybrid Emotion',
 'transmission': 'automatic',
 'trim': 'Emotion',
 'year': 2017}
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN25328%27 HTTP/1.1" 200 None
2026-03-30 11:06:09 [auto1.es] INFO: Saving data for CN25328: {'created_time': 1774868769.150429, 'last_price_update_time': 1774868769.15044, 'auction_closing_time': 1774971466.0}
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CN25328') HTTP/1.1" 204 0
2026-03-30 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_13a75fe9acd257929a373774f3e75e9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb669bfd0>
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_13a75fe9acd257929a373774f3e75e9e.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_13a75fe9acd257929a373774f3e75e9e.jpg saved to cache
2026-03-30 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_2ce0ca270c21685f26791cc7cb64ac33.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb64374d0>
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_2ce0ca270c21685f26791cc7cb64ac33.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_2ce0ca270c21685f26791cc7cb64ac33.jpg saved to cache
2026-03-30 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_bb88603531618b8271868835b4c61ad9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66f3950>
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_bb88603531618b8271868835b4c61ad9.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_bb88603531618b8271868835b4c61ad9.jpg saved to cache
2026-03-30 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV97733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_07517fb3ff2ceefd7853e612a517b5f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6437810>
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_07517fb3ff2ceefd7853e612a517b5f4.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_07517fb3ff2ceefd7853e612a517b5f4.jpg saved to cache
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_48380e07bec3ed952bc5d4b485cb37ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_61e176d17b6bae70a9e70d9abb6e9b1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb660d150>
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_48380e07bec3ed952bc5d4b485cb37ac.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_48380e07bec3ed952bc5d4b485cb37ac.jpg saved to cache
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_72dab720e956b7f31cefdf1b43207ce9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65b5fd0>
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_61e176d17b6bae70a9e70d9abb6e9b1d.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_61e176d17b6bae70a9e70d9abb6e9b1d.jpg saved to cache
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_7f9b9a0a8c3e1281953cee17cbad3968.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb669a390>
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_72dab720e956b7f31cefdf1b43207ce9.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_72dab720e956b7f31cefdf1b43207ce9.jpg saved to cache
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6699450>
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_7f9b9a0a8c3e1281953cee17cbad3968.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_7f9b9a0a8c3e1281953cee17cbad3968.jpg saved to cache
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_6904d599e42b3a34c6bfe60ff84ed6ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_421831066431b861b53bf1098d1d7962.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc2921d0>
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_6904d599e42b3a34c6bfe60ff84ed6ff.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_6904d599e42b3a34c6bfe60ff84ed6ff.jpg saved to cache
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6437910>
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb3%252Fdcb32f8a347b17dce57c6d67c911228c%252Fpa%252FCS18860_421831066431b861b53bf1098d1d7962.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_421831066431b861b53bf1098d1d7962.jpg saved to cache
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d48c4d5b-a8ba-5406-a5ce-183f2835debd
2026-03-30 11:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d48c4d5b-a8ba-5406-a5ce-183f2835debd, skipping ID generation
2026-03-30 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d48c4d5b-a8ba-5406-a5ce-183f2835debd with scrape type 1
2026-03-30 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d48c4d5b-a8ba-5406-a5ce-183f2835debd sending to next pipeline
2026-03-30 11:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d48c4d5b-a8ba-5406-a5ce-183f2835debd, identifier: CS18860
2026-03-30 11:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d48c4d5b-a8ba-5406-a5ce-183f2835debd with identifier: CS18860
2026-03-30 11:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d48c4d5b-a8ba-5406-a5ce-183f2835debd with identifier: CS18860
2026-03-30 11:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d48c4d5b-a8ba-5406-a5ce-183f2835debd with identifier: CS18860 to the API
2026-03-30 11:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_421831066431b861b53bf1098d1d7962.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:47:46Z',
 'fuel_type': 'diesel',
 'id': 'd48c4d5b-a8ba-5406-a5ce-183f2835debd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS18860',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 96598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_421831066431b861b53bf1098d1d7962.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_6904d599e42b3a34c6bfe60ff84ed6ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_7f9b9a0a8c3e1281953cee17cbad3968.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_72dab720e956b7f31cefdf1b43207ce9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_61e176d17b6bae70a9e70d9abb6e9b1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_48380e07bec3ed952bc5d4b485cb37ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_07517fb3ff2ceefd7853e612a517b5f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_bb88603531618b8271868835b4c61ad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_2ce0ca270c21685f26791cc7cb64ac33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d48c4d5b-a8ba-5406-a5ce-183f2835debd/d48c4d5b-a8ba-5406-a5ce-183f2835debd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b3/dcb32f8a347b17dce57c6d67c911228c/pa/CS18860_13a75fe9acd257929a373774f3e75e9e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2016}
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS18860%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.es] INFO: Saving data for CS18860: {'created_time': 1774868771.214274, 'last_price_update_time': 1774868771.214285, 'auction_closing_time': 1774972066.0}
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CS18860') HTTP/1.1" 204 0
2026-03-30 11:06:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.075(s), this was the 1st time calling it.
2026-03-30 11:06:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.082305513397761 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC12425/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR65980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK20362> (referer: https://www.auto1.com/v1/car-details-view/UK20362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1d7f199-ebae-5b6a-abe0-657d53e6fa53 with identifier: UK20362
2026-03-30 11:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53 with scrape type 1
2026-03-30 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_457a25721de814067392d0193f9b3ec6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_457a25721de814067392d0193f9b3ec6.jpg not downloaded yet
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_6e118552c6d596bdee5714504548f62a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_6e118552c6d596bdee5714504548f62a.jpg not downloaded yet
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_69791919d608516262f6a493a50d871f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_69791919d608516262f6a493a50d871f.jpg not downloaded yet
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_523a20dcc9167c6166010c91458d8f32.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_523a20dcc9167c6166010c91458d8f32.jpg not downloaded yet
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_8b4812ac804a2bb5f88b68faca204052.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_8b4812ac804a2bb5f88b68faca204052.jpg not downloaded yet
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_d9e63952e602c0364c93ac465d260057.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_d9e63952e602c0364c93ac465d260057.jpg not downloaded yet
2026-03-30 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_aa7711dcf8132ca1e0300b205643ebdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_aa7711dcf8132ca1e0300b205643ebdd.jpg not downloaded yet
2026-03-30 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_d58cdc278e632a6683f43742c9ad9412.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_d58cdc278e632a6683f43742c9ad9412.jpg not downloaded yet
2026-03-30 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_5a64660aaaf5bbb09befdac4aa9fd359.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_5a64660aaaf5bbb09befdac4aa9fd359.jpg not downloaded yet
2026-03-30 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_77dd617f40f09e21f26b864e65dfead9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_77dd617f40f09e21f26b864e65dfead9.jpg not downloaded yet
2026-03-30 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX54555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_77dd617f40f09e21f26b864e65dfead9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_5a64660aaaf5bbb09befdac4aa9fd359.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c0d90>
2026-03-30 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_77dd617f40f09e21f26b864e65dfead9.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_77dd617f40f09e21f26b864e65dfead9.jpg saved to cache
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fca810>
2026-03-30 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_5a64660aaaf5bbb09befdac4aa9fd359.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_5a64660aaaf5bbb09befdac4aa9fd359.jpg saved to cache
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:07:04 [scrapy.extensions.logstats] INFO: Crawled 91 pages (at 7 pages/min), scraped 135 items (at 2 items/min)
2026-03-30 11:07:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT88703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_d58cdc278e632a6683f43742c9ad9412.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c23d0>
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_d58cdc278e632a6683f43742c9ad9412.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_d58cdc278e632a6683f43742c9ad9412.jpg saved to cache
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_aa7711dcf8132ca1e0300b205643ebdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc290690>
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_aa7711dcf8132ca1e0300b205643ebdd.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_aa7711dcf8132ca1e0300b205643ebdd.jpg saved to cache
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:15 [auto1.es] INFO: Channel: 24h | Page: 9 | totalHits: 2198 | hits on page: 40
2026-03-30 11:07:15 [auto1.es] INFO: Found listing with ID: RK47874
2026-03-30 11:07:15 [auto1.es] INFO: Found listing with ID: LA75479
2026-03-30 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA75479%27 HTTP/1.1" 200 None
2026-03-30 11:07:16 [auto1.es] INFO: Scrape type for LA75479: 0
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: UX44517
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX44517%27 HTTP/1.1" 200 None
2026-03-30 11:07:16 [auto1.es] INFO: Scrape type for UX44517: 0
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: UG86344
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: YK20837
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: BA34469
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: RF07608
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: BU05339
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU05339%27 HTTP/1.1" 200 None
2026-03-30 11:07:16 [auto1.es] INFO: Scrape type for BU05339: 2
2026-03-30 11:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1fae314-2799-512d-b873-64d45d10fcb0 with identifier: BU05339
2026-03-30 11:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1fae314-2799-512d-b873-64d45d10fcb0 with scrape type 2
2026-03-30 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1fae314-2799-512d-b873-64d45d10fcb0 with scrape type 2
2026-03-30 11:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1fae314-2799-512d-b873-64d45d10fcb0, identifier: BU05339
2026-03-30 11:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1fae314-2799-512d-b873-64d45d10fcb0 with identifier: BU05339
2026-03-30 11:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1fae314-2799-512d-b873-64d45d10fcb0 with identifier: BU05339
2026-03-30 11:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1fae314-2799-512d-b873-64d45d10fcb0 with identifier: BU05339 to the API
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:55:47Z',
 'fuel_type': 'petrol',
 'id': 'd1fae314-2799-512d-b873-64d45d10fcb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU05339',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 205614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU05339%27 HTTP/1.1" 200 None
2026-03-30 11:07:16 [auto1.es] INFO: Saving data for BU05339: {'auction_closing_time': 1774972547.0, 'created_time': 1773216758.953332, 'last_price_update_time': 1774868836.460433}
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BU05339') HTTP/1.1" 204 0
2026-03-30 11:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_d9e63952e602c0364c93ac465d260057.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: CL24407
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL24407%27 HTTP/1.1" 200 None
2026-03-30 11:07:16 [auto1.es] INFO: Scrape type for CL24407: 1
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: PU52673
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: GJ54103
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: UB08754
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: NG44880
2026-03-30 11:07:16 [auto1.es] INFO: Found listing with ID: GS81251
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS81251%27 HTTP/1.1" 200 None
2026-03-30 11:07:16 [auto1.es] INFO: Scrape type for GS81251: 2
2026-03-30 11:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c6cae47-b308-5c45-968d-f4dad31860dc with identifier: GS81251
2026-03-30 11:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c6cae47-b308-5c45-968d-f4dad31860dc with scrape type 2
2026-03-30 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c6cae47-b308-5c45-968d-f4dad31860dc with scrape type 2
2026-03-30 11:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1c6cae47-b308-5c45-968d-f4dad31860dc, identifier: GS81251
2026-03-30 11:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1c6cae47-b308-5c45-968d-f4dad31860dc with identifier: GS81251
2026-03-30 11:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1c6cae47-b308-5c45-968d-f4dad31860dc with identifier: GS81251
2026-03-30 11:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1c6cae47-b308-5c45-968d-f4dad31860dc with identifier: GS81251 to the API
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:05:56Z',
 'fuel_type': 'diesel',
 'id': '1c6cae47-b308-5c45-968d-f4dad31860dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS81251',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 201084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-03',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS81251%27 HTTP/1.1" 200 None
2026-03-30 11:07:17 [auto1.es] INFO: Saving data for GS81251: {'auction_closing_time': 1774969556.0, 'created_time': 1773345807.580053, 'last_price_update_time': 1774868837.036511}
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GS81251') HTTP/1.1" 204 0
2026-03-30 11:07:17 [auto1.es] INFO: Found listing with ID: AV47736
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV47736%27 HTTP/1.1" 200 None
2026-03-30 11:07:17 [auto1.es] INFO: Scrape type for AV47736: 2
2026-03-30 11:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c4043d-67f7-5d98-9de7-15476e9a0326 with identifier: AV47736
2026-03-30 11:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c4043d-67f7-5d98-9de7-15476e9a0326 with scrape type 2
2026-03-30 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0c4043d-67f7-5d98-9de7-15476e9a0326 with scrape type 2
2026-03-30 11:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0c4043d-67f7-5d98-9de7-15476e9a0326, identifier: AV47736
2026-03-30 11:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0c4043d-67f7-5d98-9de7-15476e9a0326 with identifier: AV47736
2026-03-30 11:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0c4043d-67f7-5d98-9de7-15476e9a0326 with identifier: AV47736
2026-03-30 11:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0c4043d-67f7-5d98-9de7-15476e9a0326 with identifier: AV47736 to the API
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:17:17Z',
 'fuel_type': 'petrol',
 'id': 'b0c4043d-67f7-5d98-9de7-15476e9a0326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV47736',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 58906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2022}
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV47736%27 HTTP/1.1" 200 None
2026-03-30 11:07:17 [auto1.es] INFO: Saving data for AV47736: {'auction_closing_time': 1774970237.0, 'created_time': 1773399803.333856, 'last_price_update_time': 1774868837.514209}
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AV47736') HTTP/1.1" 204 0
2026-03-30 11:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c3890>
2026-03-30 11:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_d9e63952e602c0364c93ac465d260057.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_d9e63952e602c0364c93ac465d260057.jpg saved to cache
2026-03-30 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:07:17 [auto1.es] INFO: Found listing with ID: VB30178
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB30178%27 HTTP/1.1" 200 None
2026-03-30 11:07:17 [auto1.es] INFO: Scrape type for VB30178: 2
2026-03-30 11:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 575455f4-1c35-598c-b45e-c62140c99f42 with identifier: VB30178
2026-03-30 11:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 575455f4-1c35-598c-b45e-c62140c99f42 with scrape type 2
2026-03-30 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 575455f4-1c35-598c-b45e-c62140c99f42 with scrape type 2
2026-03-30 11:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 575455f4-1c35-598c-b45e-c62140c99f42, identifier: VB30178
2026-03-30 11:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 575455f4-1c35-598c-b45e-c62140c99f42 with identifier: VB30178
2026-03-30 11:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 575455f4-1c35-598c-b45e-c62140c99f42 with identifier: VB30178
2026-03-30 11:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 575455f4-1c35-598c-b45e-c62140c99f42 with identifier: VB30178 to the API
2026-03-30 11:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:03:14Z',
 'fuel_type': 'petrol',
 'id': '575455f4-1c35-598c-b45e-c62140c99f42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB30178',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 163251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2020}
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB30178%27 HTTP/1.1" 200 None
2026-03-30 11:07:18 [auto1.es] INFO: Saving data for VB30178: {'auction_closing_time': 1774969394.0, 'created_time': 1773129224.119305, 'last_price_update_time': 1774868838.244242}
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VB30178') HTTP/1.1" 204 0
2026-03-30 11:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK17628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:18 [auto1.es] INFO: Found listing with ID: MB25535
2026-03-30 11:07:18 [auto1.es] INFO: Found listing with ID: NF93358
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF93358%27 HTTP/1.1" 200 None
2026-03-30 11:07:18 [auto1.es] INFO: Scrape type for NF93358: 2
2026-03-30 11:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c53289-7225-5641-9f25-86cd923653cf with identifier: NF93358
2026-03-30 11:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c53289-7225-5641-9f25-86cd923653cf with scrape type 2
2026-03-30 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26c53289-7225-5641-9f25-86cd923653cf with scrape type 2
2026-03-30 11:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 26c53289-7225-5641-9f25-86cd923653cf, identifier: NF93358
2026-03-30 11:07:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 26c53289-7225-5641-9f25-86cd923653cf with identifier: NF93358
2026-03-30 11:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 26c53289-7225-5641-9f25-86cd923653cf with identifier: NF93358
2026-03-30 11:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 26c53289-7225-5641-9f25-86cd923653cf with identifier: NF93358 to the API
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:24:02Z',
 'fuel_type': 'diesel',
 'id': '26c53289-7225-5641-9f25-86cd923653cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF93358',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 193346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-04',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2019}
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF93358%27 HTTP/1.1" 200 None
2026-03-30 11:07:18 [auto1.es] INFO: Saving data for NF93358: {'auction_closing_time': 1774970642.0, 'created_time': 1773145430.957758, 'last_price_update_time': 1774868838.870561}
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NF93358') HTTP/1.1" 204 0
2026-03-30 11:07:18 [auto1.es] INFO: Found listing with ID: NM50229
2026-03-30 11:07:18 [auto1.es] INFO: Found listing with ID: UC04153
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC04153%27 HTTP/1.1" 200 None
2026-03-30 11:07:18 [auto1.es] INFO: Scrape type for UC04153: 2
2026-03-30 11:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16f5f935-d06b-5194-9302-99c4db1f0dd4 with identifier: UC04153
2026-03-30 11:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16f5f935-d06b-5194-9302-99c4db1f0dd4 with scrape type 2
2026-03-30 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16f5f935-d06b-5194-9302-99c4db1f0dd4 with scrape type 2
2026-03-30 11:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 16f5f935-d06b-5194-9302-99c4db1f0dd4, identifier: UC04153
2026-03-30 11:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 16f5f935-d06b-5194-9302-99c4db1f0dd4 with identifier: UC04153
2026-03-30 11:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 16f5f935-d06b-5194-9302-99c4db1f0dd4 with identifier: UC04153
2026-03-30 11:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 16f5f935-d06b-5194-9302-99c4db1f0dd4 with identifier: UC04153 to the API
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:41:36Z',
 'fuel_type': 'diesel',
 'id': '16f5f935-d06b-5194-9302-99c4db1f0dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC04153',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 337119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-29',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active L1',
 'transmission': 'manual',
 'trim': 'Active L1',
 'year': 2019}
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC04153%27 HTTP/1.1" 200 None
2026-03-30 11:07:19 [auto1.es] INFO: Saving data for UC04153: {'auction_closing_time': 1774971696.0, 'created_time': 1774296131.444697, 'last_price_update_time': 1774868839.284826}
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UC04153') HTTP/1.1" 204 0
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: WB78314
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: LS16672
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: ZY06660
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: PY56166
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: BB23821
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB23821%27 HTTP/1.1" 200 None
2026-03-30 11:07:19 [auto1.es] INFO: Scrape type for BB23821: 2
2026-03-30 11:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90779a30-cb6f-5b0b-af94-b8ed1553c6aa with identifier: BB23821
2026-03-30 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90779a30-cb6f-5b0b-af94-b8ed1553c6aa with scrape type 2
2026-03-30 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90779a30-cb6f-5b0b-af94-b8ed1553c6aa with scrape type 2
2026-03-30 11:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90779a30-cb6f-5b0b-af94-b8ed1553c6aa, identifier: BB23821
2026-03-30 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY22217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90779a30-cb6f-5b0b-af94-b8ed1553c6aa with identifier: BB23821
2026-03-30 11:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90779a30-cb6f-5b0b-af94-b8ed1553c6aa with identifier: BB23821
2026-03-30 11:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90779a30-cb6f-5b0b-af94-b8ed1553c6aa with identifier: BB23821 to the API
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-31T15:40:00Z',
 'fuel_type': 'diesel',
 'id': '90779a30-cb6f-5b0b-af94-b8ed1553c6aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB23821',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 127137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 300 d AVANTGARDE lang',
 'transmission': 'automatic',
 'trim': 'AVANTGARDE lang',
 'year': 2019}
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB23821%27 HTTP/1.1" 200 None
2026-03-30 11:07:19 [auto1.es] INFO: Saving data for BB23821: {'auction_closing_time': 1774971600.0, 'created_time': 1773691537.816463, 'last_price_update_time': 1774868839.883757}
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB23821') HTTP/1.1" 204 0
2026-03-30 11:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: DX58510
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX58510%27 HTTP/1.1" 200 None
2026-03-30 11:07:19 [auto1.es] INFO: Scrape type for DX58510: 1
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: RD08609
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: DK89314
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: WU12290
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU12290%27 HTTP/1.1" 200 None
2026-03-30 11:07:19 [auto1.es] INFO: Scrape type for WU12290: 1
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: KZ68230
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ68230%27 HTTP/1.1" 200 None
2026-03-30 11:07:19 [auto1.es] INFO: Scrape type for KZ68230: 1
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: WU48196
2026-03-30 11:07:19 [auto1.es] INFO: Found listing with ID: EN72031
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN72031%27 HTTP/1.1" 200 None
2026-03-30 11:07:19 [auto1.es] INFO: Scrape type for EN72031: 2
2026-03-30 11:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb2a9f2c-bb8c-5054-8b20-cce8d960b894 with identifier: EN72031
2026-03-30 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2a9f2c-bb8c-5054-8b20-cce8d960b894 with scrape type 2
2026-03-30 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb2a9f2c-bb8c-5054-8b20-cce8d960b894 with scrape type 2
2026-03-30 11:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb2a9f2c-bb8c-5054-8b20-cce8d960b894, identifier: EN72031
2026-03-30 11:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb2a9f2c-bb8c-5054-8b20-cce8d960b894 with identifier: EN72031
2026-03-30 11:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb2a9f2c-bb8c-5054-8b20-cce8d960b894 with identifier: EN72031
2026-03-30 11:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bb2a9f2c-bb8c-5054-8b20-cce8d960b894 with identifier: EN72031 to the API
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:33:49Z',
 'fuel_type': 'diesel',
 'id': 'bb2a9f2c-bb8c-5054-8b20-cce8d960b894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN72031',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 150911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-13',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN72031%27 HTTP/1.1" 200 None
2026-03-30 11:07:20 [auto1.es] INFO: Saving data for EN72031: {'auction_closing_time': 1774971229.0, 'created_time': 1773146566.011628, 'last_price_update_time': 1774868840.393954}
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EN72031') HTTP/1.1" 204 0
2026-03-30 11:07:20 [auto1.es] INFO: Found listing with ID: HH73339
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH73339%27 HTTP/1.1" 200 None
2026-03-30 11:07:20 [auto1.es] INFO: Scrape type for HH73339: 1
2026-03-30 11:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_8b4812ac804a2bb5f88b68faca204052.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:20 [auto1.es] INFO: Found listing with ID: RV47114
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV47114%27 HTTP/1.1" 200 None
2026-03-30 11:07:20 [auto1.es] INFO: Scrape type for RV47114: 2
2026-03-30 11:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34597341-407d-517d-970f-c3a1c57883c1 with identifier: RV47114
2026-03-30 11:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34597341-407d-517d-970f-c3a1c57883c1 with scrape type 2
2026-03-30 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34597341-407d-517d-970f-c3a1c57883c1 with scrape type 2
2026-03-30 11:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 34597341-407d-517d-970f-c3a1c57883c1, identifier: RV47114
2026-03-30 11:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 34597341-407d-517d-970f-c3a1c57883c1 with identifier: RV47114
2026-03-30 11:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 34597341-407d-517d-970f-c3a1c57883c1 with identifier: RV47114
2026-03-30 11:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 34597341-407d-517d-970f-c3a1c57883c1 with identifier: RV47114 to the API
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:04:57Z',
 'fuel_type': 'diesel',
 'id': '34597341-407d-517d-970f-c3a1c57883c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV47114',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 181638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2008}
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV47114%27 HTTP/1.1" 200 None
2026-03-30 11:07:20 [auto1.es] INFO: Saving data for RV47114: {'auction_closing_time': 1774969497.0, 'created_time': 1773756184.855588, 'last_price_update_time': 1774868840.93899}
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RV47114') HTTP/1.1" 204 0
2026-03-30 11:07:20 [auto1.es] INFO: Found listing with ID: SN50770
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN50770%27 HTTP/1.1" 200 None
2026-03-30 11:07:20 [auto1.es] INFO: Scrape type for SN50770: 2
2026-03-30 11:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a291c30-7527-52c9-a866-5c68358b96d6 with identifier: SN50770
2026-03-30 11:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a291c30-7527-52c9-a866-5c68358b96d6 with scrape type 2
2026-03-30 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a291c30-7527-52c9-a866-5c68358b96d6 with scrape type 2
2026-03-30 11:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a291c30-7527-52c9-a866-5c68358b96d6, identifier: SN50770
2026-03-30 11:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a291c30-7527-52c9-a866-5c68358b96d6 with identifier: SN50770
2026-03-30 11:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a291c30-7527-52c9-a866-5c68358b96d6 with identifier: SN50770
2026-03-30 11:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8a291c30-7527-52c9-a866-5c68358b96d6 with identifier: SN50770 to the API
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:18:48Z',
 'fuel_type': 'diesel',
 'id': '8a291c30-7527-52c9-a866-5c68358b96d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN50770',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 215584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-25',
 'seller_name': None,
 'title': 'Peugeot 407 2.0 HDi ST Sport Pack',
 'transmission': 'manual',
 'trim': 'ST Sport Pack',
 'year': 2004}
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN50770%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [auto1.es] INFO: Saving data for SN50770: {'auction_closing_time': 1774970328.0, 'created_time': 1773432299.512637, 'last_price_update_time': 1774868841.380347}
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SN50770') HTTP/1.1" 204 0
2026-03-30 11:07:21 [auto1.es] INFO: Found listing with ID: JL69651
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL69651%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [auto1.es] INFO: Scrape type for JL69651: 2
2026-03-30 11:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 603b5e77-1523-5c7f-8169-8a524d8d5d96 with identifier: JL69651
2026-03-30 11:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603b5e77-1523-5c7f-8169-8a524d8d5d96 with scrape type 2
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 603b5e77-1523-5c7f-8169-8a524d8d5d96 with scrape type 2
2026-03-30 11:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 603b5e77-1523-5c7f-8169-8a524d8d5d96, identifier: JL69651
2026-03-30 11:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV97733> (referer: https://www.auto1.com/v1/car-details-view/TV97733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 603b5e77-1523-5c7f-8169-8a524d8d5d96 with identifier: JL69651
2026-03-30 11:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 603b5e77-1523-5c7f-8169-8a524d8d5d96 with identifier: JL69651
2026-03-30 11:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 603b5e77-1523-5c7f-8169-8a524d8d5d96 with identifier: JL69651 to the API
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:30:45Z',
 'fuel_type': 'diesel',
 'id': '603b5e77-1523-5c7f-8169-8a524d8d5d96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL69651',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 230066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-29',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 HDi SX',
 'transmission': 'automatic',
 'trim': 'SX',
 'year': 2008}
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL69651%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [auto1.es] INFO: Saving data for JL69651: {'auction_closing_time': 1774971045.0, 'created_time': 1773129221.299275, 'last_price_update_time': 1774868842.150653}
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JL69651') HTTP/1.1" 204 0
2026-03-30 11:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66beb90>
2026-03-30 11:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_8b4812ac804a2bb5f88b68faca204052.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_8b4812ac804a2bb5f88b68faca204052.jpg saved to cache
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:07:22 [auto1.es] INFO: Found listing with ID: UE43737
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE43737%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [auto1.es] INFO: Scrape type for UE43737: 1
2026-03-30 11:07:22 [auto1.es] INFO: Found listing with ID: UR76299
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR76299%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [auto1.es] INFO: Scrape type for UR76299: 2
2026-03-30 11:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ceb6a1-5422-51ef-8a3e-bad59e94b96c with identifier: UR76299
2026-03-30 11:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ceb6a1-5422-51ef-8a3e-bad59e94b96c with scrape type 2
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6ceb6a1-5422-51ef-8a3e-bad59e94b96c with scrape type 2
2026-03-30 11:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6ceb6a1-5422-51ef-8a3e-bad59e94b96c, identifier: UR76299
2026-03-30 11:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6ceb6a1-5422-51ef-8a3e-bad59e94b96c with identifier: UR76299
2026-03-30 11:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6ceb6a1-5422-51ef-8a3e-bad59e94b96c with identifier: UR76299
2026-03-30 11:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b6ceb6a1-5422-51ef-8a3e-bad59e94b96c with identifier: UR76299 to the API
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:01:45Z',
 'fuel_type': 'diesel',
 'id': 'b6ceb6a1-5422-51ef-8a3e-bad59e94b96c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR76299',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 253937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-02',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI T1 BlueMotion',
 'transmission': 'manual',
 'trim': 'T1 BlueMotion',
 'year': 2015}
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR76299%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [auto1.es] INFO: Saving data for UR76299: {'auction_closing_time': 1774969305.0, 'created_time': 1773432294.118162, 'last_price_update_time': 1774868842.681783}
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UR76299') HTTP/1.1" 204 0
2026-03-30 11:07:22 [auto1.es] INFO: Found listing with ID: CE82406
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE82406%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [auto1.es] INFO: Scrape type for CE82406: 1
2026-03-30 11:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 317e478f-4e4c-5172-b55f-fc90baae8990 with identifier: TV97733
2026-03-30 11:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 317e478f-4e4c-5172-b55f-fc90baae8990 with scrape type 1
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 317e478f-4e4c-5172-b55f-fc90baae8990
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_8ddbee08793bbcb17fee1a3723a44cfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_8ddbee08793bbcb17fee1a3723a44cfc.jpg already downloaded
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_98257d95dd8d6d878bd0eff4611c2411.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_98257d95dd8d6d878bd0eff4611c2411.jpg already downloaded
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_12399df03d62858046d014591dbd90ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_12399df03d62858046d014591dbd90ca.jpg already downloaded
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_874d2ee961f5f5e8fba9d9424d542806.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_874d2ee961f5f5e8fba9d9424d542806.jpg already downloaded
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_64de0e95f35a91f8dfe83ad29550df52.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_64de0e95f35a91f8dfe83ad29550df52.jpg already downloaded
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_b1b4b1485029b19705c15d500db2c109.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_b1b4b1485029b19705c15d500db2c109.jpg already downloaded
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_95bbaf936c409512f33f0298f090548f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_95bbaf936c409512f33f0298f090548f.jpg already downloaded
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_f5cf809f544ce37ab5181858f2cfac87.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_f5cf809f544ce37ab5181858f2cfac87.jpg already downloaded
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_ccb7d319f6f3a2c35d742f23288a5047.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_ccb7d319f6f3a2c35d742f23288a5047.jpg already downloaded
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20da228d8d9adbcce820e9d114830b%252Fpa%252FTV97733_302e3e335b8d117eeeba8289ed8d149c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_302e3e335b8d117eeeba8289ed8d149c.jpg already downloaded
2026-03-30 11:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 317e478f-4e4c-5172-b55f-fc90baae8990, identifier: TV97733
2026-03-30 11:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 317e478f-4e4c-5172-b55f-fc90baae8990 with identifier: TV97733
2026-03-30 11:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 317e478f-4e4c-5172-b55f-fc90baae8990 with identifier: TV97733
2026-03-30 11:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 317e478f-4e4c-5172-b55f-fc90baae8990 with identifier: TV97733 to the API
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TV97733>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:15:16Z',
 'fuel_type': 'diesel',
 'id': '317e478f-4e4c-5172-b55f-fc90baae8990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV97733',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 125787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_8ddbee08793bbcb17fee1a3723a44cfc.jpg',
                'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_98257d95dd8d6d878bd0eff4611c2411.jpg',
                'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_12399df03d62858046d014591dbd90ca.jpg',
                'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_874d2ee961f5f5e8fba9d9424d542806.jpg',
                'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_64de0e95f35a91f8dfe83ad29550df52.jpg',
                'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_b1b4b1485029b19705c15d500db2c109.jpg',
                'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_95bbaf936c409512f33f0298f090548f.jpg',
                'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_f5cf809f544ce37ab5181858f2cfac87.jpg',
                'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_ccb7d319f6f3a2c35d742f23288a5047.jpg',
                'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_302e3e335b8d117eeeba8289ed8d149c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_8ddbee08793bbcb17fee1a3723a44cfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_98257d95dd8d6d878bd0eff4611c2411.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_12399df03d62858046d014591dbd90ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_874d2ee961f5f5e8fba9d9424d542806.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_64de0e95f35a91f8dfe83ad29550df52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_b1b4b1485029b19705c15d500db2c109.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_95bbaf936c409512f33f0298f090548f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_f5cf809f544ce37ab5181858f2cfac87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_ccb7d319f6f3a2c35d742f23288a5047.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317e478f-4e4c-5172-b55f-fc90baae8990/317e478f-4e4c-5172-b55f-fc90baae8990_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20da228d8d9adbcce820e9d114830b/pa/TV97733_302e3e335b8d117eeeba8289ed8d149c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2021}
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV97733%27 HTTP/1.1" 200 None
2026-03-30 11:07:23 [auto1.es] INFO: Saving data for TV97733: {'created_time': 1774868843.471193, 'last_price_update_time': 1774868843.471205, 'auction_closing_time': 1774970116.0}
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV97733') HTTP/1.1" 204 0
2026-03-30 11:07:23 [auto1.es] INFO: Found listing with ID: CP05375
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP05375%27 HTTP/1.1" 200 None
2026-03-30 11:07:23 [auto1.es] INFO: Scrape type for CP05375: 2
2026-03-30 11:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a931e2e-6ec0-5c83-9115-93934e3fb0b3 with identifier: CP05375
2026-03-30 11:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a931e2e-6ec0-5c83-9115-93934e3fb0b3 with scrape type 2
2026-03-30 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a931e2e-6ec0-5c83-9115-93934e3fb0b3 with scrape type 2
2026-03-30 11:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a931e2e-6ec0-5c83-9115-93934e3fb0b3, identifier: CP05375
2026-03-30 11:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a931e2e-6ec0-5c83-9115-93934e3fb0b3 with identifier: CP05375
2026-03-30 11:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a931e2e-6ec0-5c83-9115-93934e3fb0b3 with identifier: CP05375
2026-03-30 11:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2a931e2e-6ec0-5c83-9115-93934e3fb0b3 with identifier: CP05375 to the API
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:34:44Z',
 'fuel_type': 'diesel',
 'id': '2a931e2e-6ec0-5c83-9115-93934e3fb0b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP05375',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 173153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-26',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP05375%27 HTTP/1.1" 200 None
2026-03-30 11:07:23 [auto1.es] INFO: Saving data for CP05375: {'auction_closing_time': 1774971284.0, 'created_time': 1774296203.59997, 'last_price_update_time': 1774868843.91965}
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CP05375') HTTP/1.1" 204 0
2026-03-30 11:07:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.792(s), this was the 1st time calling it.
2026-03-30 11:07:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.404650317164762 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV35004/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM64147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.017(s), this was the 1st time calling it.
2026-03-30 11:07:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.32361568425164 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:08:04 [scrapy.extensions.logstats] INFO: Crawled 98 pages (at 7 pages/min), scraped 149 items (at 14 items/min)
2026-03-30 11:08:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH15293> (referer: https://www.auto1.com/v1/car-details-view/VH15293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee9d216e-d41c-5a90-a013-ec29f1a53ca4 with identifier: VH15293
2026-03-30 11:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4 with scrape type 1
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_a7b6c47d93fe8d49def456464a6f6c27.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a7b6c47d93fe8d49def456464a6f6c27.jpg not downloaded yet
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_a719e428b5d116612a8c9449b11eee04.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a719e428b5d116612a8c9449b11eee04.jpg not downloaded yet
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_b9a1c21d53cadb6a6e2587ff83b7dfb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_b9a1c21d53cadb6a6e2587ff83b7dfb8.jpg not downloaded yet
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_9e37f2f3a9e69af9b63f4b0677f56fdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_9e37f2f3a9e69af9b63f4b0677f56fdd.jpg not downloaded yet
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_badc434a2e1a053f89db76f46159674f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_badc434a2e1a053f89db76f46159674f.jpg not downloaded yet
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_8861cb8ad73d7c88a4c7dd5fe3d345a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_8861cb8ad73d7c88a4c7dd5fe3d345a5.jpg not downloaded yet
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_348dbbb807417cb15f836cf20d86d644.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_348dbbb807417cb15f836cf20d86d644.jpg not downloaded yet
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_a673c7358730208b2a9d5db481ba33f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a673c7358730208b2a9d5db481ba33f7.jpg not downloaded yet
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_456e96a056f9d4ef312c1e5a38b5941d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_456e96a056f9d4ef312c1e5a38b5941d.jpg not downloaded yet
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_f9b4fa41f4f8283cd8d3dfc9e11ab40a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_f9b4fa41f4f8283cd8d3dfc9e11ab40a.jpg not downloaded yet
2026-03-30 11:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX54555> (referer: https://www.auto1.com/v1/car-details-view/AX54555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd1567a4-fc47-5960-8c7b-14c50d03982b with identifier: AX54555
2026-03-30 11:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd1567a4-fc47-5960-8c7b-14c50d03982b with scrape type 1
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd1567a4-fc47-5960-8c7b-14c50d03982b
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_2efd9c896c93dbd5ec3ce6464f04991c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_2efd9c896c93dbd5ec3ce6464f04991c.jpg already downloaded
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_1f163e4c31c2f531362186f65cb386c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_1f163e4c31c2f531362186f65cb386c0.jpg already downloaded
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_dccc31b5abe11e1777b19d9ad8b6630e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_dccc31b5abe11e1777b19d9ad8b6630e.jpg already downloaded
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_9cf7a02826eeec356b6f193eeee2fc53.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_9cf7a02826eeec356b6f193eeee2fc53.jpg already downloaded
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_1974913a2bd97e3ff132d1e43dbb41fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_1974913a2bd97e3ff132d1e43dbb41fe.jpg already downloaded
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_ba2199deb416a70162c53504e3cea835.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_ba2199deb416a70162c53504e3cea835.jpg already downloaded
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_b27a191de247c64fa163270743fcdfe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_b27a191de247c64fa163270743fcdfe4.jpg already downloaded
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_9849e99b0542d702b563dd27f2501204.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_9849e99b0542d702b563dd27f2501204.jpg already downloaded
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_a39ef3da7fa8aab09e438b58cce0fc49.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_a39ef3da7fa8aab09e438b58cce0fc49.jpg already downloaded
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F44%252F5e44ec6f8f579773580518ec14848491%252Fpa%252FAX54555_5703e0440f9903ac048dabf4fbfa6be4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_5703e0440f9903ac048dabf4fbfa6be4.jpg already downloaded
2026-03-30 11:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cd1567a4-fc47-5960-8c7b-14c50d03982b, identifier: AX54555
2026-03-30 11:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cd1567a4-fc47-5960-8c7b-14c50d03982b with identifier: AX54555
2026-03-30 11:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cd1567a4-fc47-5960-8c7b-14c50d03982b with identifier: AX54555
2026-03-30 11:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cd1567a4-fc47-5960-8c7b-14c50d03982b with identifier: AX54555 to the API
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AX54555>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 428,
 'expiration_date': '2026-03-31T15:57:55Z',
 'fuel_type': 'electro',
 'id': 'cd1567a4-fc47-5960-8c7b-14c50d03982b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX54555',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Hyundai',
 'model': 'IONIQ 9',
 'odometer': 4375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_2efd9c896c93dbd5ec3ce6464f04991c.jpg',
                'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_1f163e4c31c2f531362186f65cb386c0.jpg',
                'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_dccc31b5abe11e1777b19d9ad8b6630e.jpg',
                'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_9cf7a02826eeec356b6f193eeee2fc53.jpg',
                'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_1974913a2bd97e3ff132d1e43dbb41fe.jpg',
                'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_ba2199deb416a70162c53504e3cea835.jpg',
                'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_b27a191de247c64fa163270743fcdfe4.jpg',
                'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_9849e99b0542d702b563dd27f2501204.jpg',
                'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_a39ef3da7fa8aab09e438b58cce0fc49.jpg',
                'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_5703e0440f9903ac048dabf4fbfa6be4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_2efd9c896c93dbd5ec3ce6464f04991c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_1f163e4c31c2f531362186f65cb386c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_dccc31b5abe11e1777b19d9ad8b6630e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_9cf7a02826eeec356b6f193eeee2fc53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_1974913a2bd97e3ff132d1e43dbb41fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_ba2199deb416a70162c53504e3cea835.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_b27a191de247c64fa163270743fcdfe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_9849e99b0542d702b563dd27f2501204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_a39ef3da7fa8aab09e438b58cce0fc49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1567a4-fc47-5960-8c7b-14c50d03982b/cd1567a4-fc47-5960-8c7b-14c50d03982b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/44/5e44ec6f8f579773580518ec14848491/pa/AX54555_5703e0440f9903ac048dabf4fbfa6be4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-10-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Hyundai IONIQ 9 electric drive 315 kW Performance Uniq 4WD',
 'transmission': 'automatic',
 'trim': 'Performance Uniq 4WD',
 'year': 2025}
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX54555%27 HTTP/1.1" 200 None
2026-03-30 11:08:06 [auto1.es] INFO: Saving data for AX54555: {'created_time': 1774868886.920278, 'last_price_update_time': 1774868886.920289, 'auction_closing_time': 1774972675.0}
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AX54555') HTTP/1.1" 204 0
2026-03-30 11:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_f9b4fa41f4f8283cd8d3dfc9e11ab40a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_456e96a056f9d4ef312c1e5a38b5941d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb660dad0>
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_f9b4fa41f4f8283cd8d3dfc9e11ab40a.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_f9b4fa41f4f8283cd8d3dfc9e11ab40a.jpg saved to cache
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6435b50>
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_456e96a056f9d4ef312c1e5a38b5941d.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_456e96a056f9d4ef312c1e5a38b5941d.jpg saved to cache
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a673c7358730208b2a9d5db481ba33f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc6dcfd0>
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_a673c7358730208b2a9d5db481ba33f7.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a673c7358730208b2a9d5db481ba33f7.jpg saved to cache
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_348dbbb807417cb15f836cf20d86d644.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66bf8d0>
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_348dbbb807417cb15f836cf20d86d644.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_348dbbb807417cb15f836cf20d86d644.jpg saved to cache
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_8861cb8ad73d7c88a4c7dd5fe3d345a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f57e90>
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_8861cb8ad73d7c88a4c7dd5fe3d345a5.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_8861cb8ad73d7c88a4c7dd5fe3d345a5.jpg saved to cache
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_badc434a2e1a053f89db76f46159674f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_9e37f2f3a9e69af9b63f4b0677f56fdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_b9a1c21d53cadb6a6e2587ff83b7dfb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL09237/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a719e428b5d116612a8c9449b11eee04.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65ca590>
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_badc434a2e1a053f89db76f46159674f.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_badc434a2e1a053f89db76f46159674f.jpg saved to cache
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb669a750>
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_9e37f2f3a9e69af9b63f4b0677f56fdd.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_9e37f2f3a9e69af9b63f4b0677f56fdd.jpg saved to cache
2026-03-30 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f55ed0>
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_b9a1c21d53cadb6a6e2587ff83b7dfb8.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_b9a1c21d53cadb6a6e2587ff83b7dfb8.jpg saved to cache
2026-03-30 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66f3b10>
2026-03-30 11:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_a719e428b5d116612a8c9449b11eee04.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a719e428b5d116612a8c9449b11eee04.jpg saved to cache
2026-03-30 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a7b6c47d93fe8d49def456464a6f6c27.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd2d78d0>
2026-03-30 11:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Faa%252F45aacedb273c8f4dcb69223eb4206a9a%252Fpa%252FVH15293_a7b6c47d93fe8d49def456464a6f6c27.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a7b6c47d93fe8d49def456464a6f6c27.jpg saved to cache
2026-03-30 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4
2026-03-30 11:08:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee9d216e-d41c-5a90-a013-ec29f1a53ca4, skipping ID generation
2026-03-30 11:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4 with scrape type 1
2026-03-30 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee9d216e-d41c-5a90-a013-ec29f1a53ca4 sending to next pipeline
2026-03-30 11:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee9d216e-d41c-5a90-a013-ec29f1a53ca4, identifier: VH15293
2026-03-30 11:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee9d216e-d41c-5a90-a013-ec29f1a53ca4 with identifier: VH15293
2026-03-30 11:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee9d216e-d41c-5a90-a013-ec29f1a53ca4 with identifier: VH15293
2026-03-30 11:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee9d216e-d41c-5a90-a013-ec29f1a53ca4 with identifier: VH15293 to the API
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a7b6c47d93fe8d49def456464a6f6c27.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:57:49Z',
 'fuel_type': 'diesel',
 'id': 'ee9d216e-d41c-5a90-a013-ec29f1a53ca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH15293',
 'listing': 'auction',
 'location': 'ES, Puerto de Santa María',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 280084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a7b6c47d93fe8d49def456464a6f6c27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a719e428b5d116612a8c9449b11eee04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_b9a1c21d53cadb6a6e2587ff83b7dfb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_9e37f2f3a9e69af9b63f4b0677f56fdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_badc434a2e1a053f89db76f46159674f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_8861cb8ad73d7c88a4c7dd5fe3d345a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_348dbbb807417cb15f836cf20d86d644.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_a673c7358730208b2a9d5db481ba33f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_456e96a056f9d4ef312c1e5a38b5941d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9d216e-d41c-5a90-a013-ec29f1a53ca4/ee9d216e-d41c-5a90-a013-ec29f1a53ca4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/aa/45aacedb273c8f4dcb69223eb4206a9a/pa/VH15293_f9b4fa41f4f8283cd8d3dfc9e11ab40a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2012}
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH15293%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.es] INFO: Saving data for VH15293: {'created_time': 1774868888.697789, 'last_price_update_time': 1774868888.697799, 'auction_closing_time': 1774972669.0}
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VH15293') HTTP/1.1" 204 0
2026-03-30 11:08:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.535(s), this was the 1st time calling it.
2026-03-30 11:08:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.953122844649569 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB45577/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ30272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC12425> (referer: https://www.auto1.com/v1/car-details-view/RC12425/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e with identifier: RC12425
2026-03-30 11:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e with scrape type 1
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_21e40ef816ce701b91072e7bbd9eb4cc.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_21e40ef816ce701b91072e7bbd9eb4cc.jpeg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_a0def967b688fd43c4d95430e017d439.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_a0def967b688fd43c4d95430e017d439.jpeg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_547a5dc42ad65d92d53daeb274bf29e0.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_547a5dc42ad65d92d53daeb274bf29e0.jpeg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_b1b95378f1c6785fe3189bc7469da7bf.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_b1b95378f1c6785fe3189bc7469da7bf.jpeg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_6491af4030dc71d7d912eac92c71bcb5.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_6491af4030dc71d7d912eac92c71bcb5.jpeg not downloaded yet
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_f8792a52db511d56e2e4d538427be0ba.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_f8792a52db511d56e2e4d538427be0ba.jpeg not downloaded yet
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_08da790147b0f90d2927f782f5d92e1f.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_08da790147b0f90d2927f782f5d92e1f.jpeg not downloaded yet
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_4cc44a887b317cf864e294c8ee93bc7a.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_4cc44a887b317cf864e294c8ee93bc7a.jpeg not downloaded yet
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_635fa4f5b670190f57043bcf1fe90554.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_635fa4f5b670190f57043bcf1fe90554.jpeg not downloaded yet
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_4338475219e13942a62565a73ac3cbaf.jpeg%27 HTTP/1.1" 200 None
2026-03-30 11:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_4338475219e13942a62565a73ac3cbaf.jpeg not downloaded yet
2026-03-30 11:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH73339/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_4338475219e13942a62565a73ac3cbaf.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc2275d0>
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_4338475219e13942a62565a73ac3cbaf.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_4338475219e13942a62565a73ac3cbaf.jpeg saved to cache
2026-03-30 11:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_635fa4f5b670190f57043bcf1fe90554.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66ae890>
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_635fa4f5b670190f57043bcf1fe90554.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_635fa4f5b670190f57043bcf1fe90554.jpeg saved to cache
2026-03-30 11:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL24407/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_4cc44a887b317cf864e294c8ee93bc7a.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc21bd10>
2026-03-30 11:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_4cc44a887b317cf864e294c8ee93bc7a.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_4cc44a887b317cf864e294c8ee93bc7a.jpeg saved to cache
2026-03-30 11:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_08da790147b0f90d2927f782f5d92e1f.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc242c10>
2026-03-30 11:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_08da790147b0f90d2927f782f5d92e1f.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_08da790147b0f90d2927f782f5d92e1f.jpeg saved to cache
2026-03-30 11:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE82406/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_f8792a52db511d56e2e4d538427be0ba.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6504e90>
2026-03-30 11:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_f8792a52db511d56e2e4d538427be0ba.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_f8792a52db511d56e2e4d538427be0ba.jpeg saved to cache
2026-03-30 11:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_6491af4030dc71d7d912eac92c71bcb5.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6434e10>
2026-03-30 11:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_6491af4030dc71d7d912eac92c71bcb5.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_6491af4030dc71d7d912eac92c71bcb5.jpeg saved to cache
2026-03-30 11:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV35004> (referer: https://www.auto1.com/v1/car-details-view/PV35004/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_b1b95378f1c6785fe3189bc7469da7bf.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8560a0f-4eac-5b54-8f64-c47e33c05c74 with identifier: PV35004
2026-03-30 11:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8560a0f-4eac-5b54-8f64-c47e33c05c74 with scrape type 1
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f8560a0f-4eac-5b54-8f64-c47e33c05c74
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_d1e1feca38c84946735346b06c419b78.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_d1e1feca38c84946735346b06c419b78.jpg not downloaded yet
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_99e832f2581c3afe57d4e81fb4df5bf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_99e832f2581c3afe57d4e81fb4df5bf3.jpg not downloaded yet
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_f8ed0bd33b4743f244e9285cc53fc5d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_f8ed0bd33b4743f244e9285cc53fc5d8.jpg not downloaded yet
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_d1566e706ba03af0b838229de6643777.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_d1566e706ba03af0b838229de6643777.jpg not downloaded yet
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_f93ce8e55badd7b308fecdbe4539af28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_f93ce8e55badd7b308fecdbe4539af28.jpg not downloaded yet
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_092807521a43527084874e655c7524f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_092807521a43527084874e655c7524f5.jpg not downloaded yet
2026-03-30 11:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6549910>
2026-03-30 11:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_b1b95378f1c6785fe3189bc7469da7bf.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_b1b95378f1c6785fe3189bc7469da7bf.jpeg saved to cache
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_547a5dc42ad65d92d53daeb274bf29e0.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc192d90>
2026-03-30 11:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_547a5dc42ad65d92d53daeb274bf29e0.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_547a5dc42ad65d92d53daeb274bf29e0.jpeg saved to cache
2026-03-30 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_092807521a43527084874e655c7524f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.207(s), this was the 1st time calling it.
2026-03-30 11:08:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.520758596372448 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6562010>
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_092807521a43527084874e655c7524f5.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_092807521a43527084874e655c7524f5.jpg saved to cache
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8560a0f-4eac-5b54-8f64-c47e33c05c74
2026-03-30 11:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_f93ce8e55badd7b308fecdbe4539af28.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6461dd0>
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_f93ce8e55badd7b308fecdbe4539af28.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_f93ce8e55badd7b308fecdbe4539af28.jpg saved to cache
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8560a0f-4eac-5b54-8f64-c47e33c05c74
2026-03-30 11:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_d1566e706ba03af0b838229de6643777.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6561cd0>
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_d1566e706ba03af0b838229de6643777.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_d1566e706ba03af0b838229de6643777.jpg saved to cache
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8560a0f-4eac-5b54-8f64-c47e33c05c74
2026-03-30 11:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_f8ed0bd33b4743f244e9285cc53fc5d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66aeed0>
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_f8ed0bd33b4743f244e9285cc53fc5d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_f8ed0bd33b4743f244e9285cc53fc5d8.jpg saved to cache
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8560a0f-4eac-5b54-8f64-c47e33c05c74
2026-03-30 11:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_99e832f2581c3afe57d4e81fb4df5bf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_d1e1feca38c84946735346b06c419b78.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6437ed0>
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_99e832f2581c3afe57d4e81fb4df5bf3.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_99e832f2581c3afe57d4e81fb4df5bf3.jpg saved to cache
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8560a0f-4eac-5b54-8f64-c47e33c05c74
2026-03-30 11:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_a0def967b688fd43c4d95430e017d439.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb660ed10>
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F15%252F3b15c646f320ecf780d9c929f840a7cc%252Fpa%252FPV35004_d1e1feca38c84946735346b06c419b78.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_d1e1feca38c84946735346b06c419b78.jpg saved to cache
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8560a0f-4eac-5b54-8f64-c47e33c05c74
2026-03-30 11:08:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8560a0f-4eac-5b54-8f64-c47e33c05c74, skipping ID generation
2026-03-30 11:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8560a0f-4eac-5b54-8f64-c47e33c05c74 with scrape type 1
2026-03-30 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8560a0f-4eac-5b54-8f64-c47e33c05c74 sending to next pipeline
2026-03-30 11:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f8560a0f-4eac-5b54-8f64-c47e33c05c74, identifier: PV35004
2026-03-30 11:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f8560a0f-4eac-5b54-8f64-c47e33c05c74 with identifier: PV35004
2026-03-30 11:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f8560a0f-4eac-5b54-8f64-c47e33c05c74 with identifier: PV35004
2026-03-30 11:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f8560a0f-4eac-5b54-8f64-c47e33c05c74 with identifier: PV35004 to the API
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_d1e1feca38c84946735346b06c419b78.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:59:41Z',
 'fuel_type': 'petrol',
 'id': 'f8560a0f-4eac-5b54-8f64-c47e33c05c74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV35004',
 'listing': 'auction',
 'location': 'ES, Leioa',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 222948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_d1e1feca38c84946735346b06c419b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_99e832f2581c3afe57d4e81fb4df5bf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_f8ed0bd33b4743f244e9285cc53fc5d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_d1566e706ba03af0b838229de6643777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_f93ce8e55badd7b308fecdbe4539af28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8560a0f-4eac-5b54-8f64-c47e33c05c74/f8560a0f-4eac-5b54-8f64-c47e33c05c74_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/15/3b15c646f320ecf780d9c929f840a7cc/pa/PV35004_092807521a43527084874e655c7524f5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 307 1.6 XT',
 'transmission': 'manual',
 'trim': 'XT',
 'year': 2005}
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV35004%27 HTTP/1.1" 200 None
2026-03-30 11:08:49 [auto1.es] INFO: Saving data for PV35004: {'created_time': 1774868929.423811, 'last_price_update_time': 1774868929.423823, 'auction_closing_time': 1774972781.0}
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PV35004') HTTP/1.1" 204 0
2026-03-30 11:08:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb660fb50>
2026-03-30 11:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_a0def967b688fd43c4d95430e017d439.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_a0def967b688fd43c4d95430e017d439.jpeg saved to cache
2026-03-30 11:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_21e40ef816ce701b91072e7bbd9eb4cc.jpeg> (referer: https://www.auto1.com/)
2026-03-30 11:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662fd50>
2026-03-30 11:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fad%252Fccadebc8bf1c3721349b181a8775ef93%252Fpa%252FRC12425_21e40ef816ce701b91072e7bbd9eb4cc.jpeg') HTTP/1.1" 204 0
2026-03-30 11:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_21e40ef816ce701b91072e7bbd9eb4cc.jpeg saved to cache
2026-03-30 11:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e
2026-03-30 11:08:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e, skipping ID generation
2026-03-30 11:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e with scrape type 1
2026-03-30 11:08:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e sending to next pipeline
2026-03-30 11:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e, identifier: RC12425
2026-03-30 11:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e with identifier: RC12425
2026-03-30 11:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e with identifier: RC12425
2026-03-30 11:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e with identifier: RC12425 to the API
2026-03-30 11:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_21e40ef816ce701b91072e7bbd9eb4cc.jpeg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:09:21Z',
 'fuel_type': 'diesel',
 'id': '28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC12425',
 'listing': 'auction',
 'location': 'ES, Granollers',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 252526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_21e40ef816ce701b91072e7bbd9eb4cc.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_a0def967b688fd43c4d95430e017d439.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_547a5dc42ad65d92d53daeb274bf29e0.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_b1b95378f1c6785fe3189bc7469da7bf.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_6491af4030dc71d7d912eac92c71bcb5.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_f8792a52db511d56e2e4d538427be0ba.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_08da790147b0f90d2927f782f5d92e1f.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_4cc44a887b317cf864e294c8ee93bc7a.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_635fa4f5b670190f57043bcf1fe90554.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e/28cae14e-0d2e-5f3f-acc3-e5b7acc14f2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ad/ccadebc8bf1c3721349b181a8775ef93/pa/RC12425_4338475219e13942a62565a73ac3cbaf.jpeg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC12425%27 HTTP/1.1" 200 None
2026-03-30 11:08:50 [auto1.es] INFO: Saving data for RC12425: {'created_time': 1774868930.340506, 'last_price_update_time': 1774868930.340519, 'auction_closing_time': 1774969761.0}
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RC12425') HTTP/1.1" 204 0
2026-03-30 11:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM64147> (referer: https://www.auto1.com/v1/car-details-view/YM64147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 574c6f65-b73b-5691-a011-cdd1f18ff6d1 with identifier: YM64147
2026-03-30 11:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 574c6f65-b73b-5691-a011-cdd1f18ff6d1 with scrape type 1
2026-03-30 11:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 574c6f65-b73b-5691-a011-cdd1f18ff6d1
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_8bea8b59c14466dbfcce4d91e9fe4f66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_8bea8b59c14466dbfcce4d91e9fe4f66.jpg already downloaded
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_93774275b58573c1dc1d565b77b867c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_93774275b58573c1dc1d565b77b867c3.jpg already downloaded
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_707ea06eb5b752b9ec0b26f258556056.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_707ea06eb5b752b9ec0b26f258556056.jpg already downloaded
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_ad4638883a034166c726b98255ea5d01.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_ad4638883a034166c726b98255ea5d01.jpg already downloaded
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_e4549187ec971a3c455855f95729d19a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_e4549187ec971a3c455855f95729d19a.jpg already downloaded
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_8779d13b5570cc13e328117157225486.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_8779d13b5570cc13e328117157225486.jpg already downloaded
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_92cf34cd390366d7641216d1a3bca254.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_92cf34cd390366d7641216d1a3bca254.jpg already downloaded
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_41d43cf50a24688674283f83b76dda22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_41d43cf50a24688674283f83b76dda22.jpg already downloaded
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_872ec97647d55c71c45c45e7c065b6dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_872ec97647d55c71c45c45e7c065b6dc.jpg already downloaded
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F59%252Fde5917c51e42db56e3cd92170e7b9efd%252Fpa%252FYM64147_4827b5df0de7560ba2fa38f26b1f695f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_4827b5df0de7560ba2fa38f26b1f695f.jpg already downloaded
2026-03-30 11:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 574c6f65-b73b-5691-a011-cdd1f18ff6d1, identifier: YM64147
2026-03-30 11:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 574c6f65-b73b-5691-a011-cdd1f18ff6d1 with identifier: YM64147
2026-03-30 11:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 574c6f65-b73b-5691-a011-cdd1f18ff6d1 with identifier: YM64147
2026-03-30 11:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 574c6f65-b73b-5691-a011-cdd1f18ff6d1 with identifier: YM64147 to the API
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YM64147>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:59:48Z',
 'fuel_type': 'diesel',
 'id': '574c6f65-b73b-5691-a011-cdd1f18ff6d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM64147',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 184141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_8bea8b59c14466dbfcce4d91e9fe4f66.jpg',
                'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_93774275b58573c1dc1d565b77b867c3.jpg',
                'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_707ea06eb5b752b9ec0b26f258556056.jpg',
                'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_ad4638883a034166c726b98255ea5d01.jpg',
                'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_e4549187ec971a3c455855f95729d19a.jpg',
                'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_8779d13b5570cc13e328117157225486.jpg',
                'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_92cf34cd390366d7641216d1a3bca254.jpg',
                'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_41d43cf50a24688674283f83b76dda22.jpg',
                'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_872ec97647d55c71c45c45e7c065b6dc.jpg',
                'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_4827b5df0de7560ba2fa38f26b1f695f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_8bea8b59c14466dbfcce4d91e9fe4f66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_93774275b58573c1dc1d565b77b867c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_707ea06eb5b752b9ec0b26f258556056.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_ad4638883a034166c726b98255ea5d01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_e4549187ec971a3c455855f95729d19a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_8779d13b5570cc13e328117157225486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_92cf34cd390366d7641216d1a3bca254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_41d43cf50a24688674283f83b76dda22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_872ec97647d55c71c45c45e7c065b6dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_574c6f65-b73b-5691-a011-cdd1f18ff6d1/574c6f65-b73b-5691-a011-cdd1f18ff6d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/59/de5917c51e42db56e3cd92170e7b9efd/pa/YM64147_4827b5df0de7560ba2fa38f26b1f695f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM64147%27 HTTP/1.1" 200 None
2026-03-30 11:09:04 [auto1.es] INFO: Saving data for YM64147: {'created_time': 1774868944.052486, 'last_price_update_time': 1774868944.0525, 'auction_closing_time': 1774972788.0}
2026-03-30 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YM64147') HTTP/1.1" 204 0
2026-03-30 11:09:04 [scrapy.extensions.logstats] INFO: Crawled 109 pages (at 11 pages/min), scraped 154 items (at 5 items/min)
2026-03-30 11:09:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE43737/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY22217> (referer: https://www.auto1.com/v1/car-details-view/VY22217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa with identifier: VY22217
2026-03-30 11:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa with scrape type 1
2026-03-30 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_9d1c691f67b948f927546efe38ec9124.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9d1c691f67b948f927546efe38ec9124.jpg not downloaded yet
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_d92cf0a2da17f0974c105020db1fba38.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_d92cf0a2da17f0974c105020db1fba38.jpg not downloaded yet
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_84bb173e7c5a86d7b6c6d288d4f29575.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_84bb173e7c5a86d7b6c6d288d4f29575.jpg not downloaded yet
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_9a8416034faebc47cf7f84110f406cbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9a8416034faebc47cf7f84110f406cbe.jpg not downloaded yet
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_9510b61e2b4732a049fe6671348dbed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9510b61e2b4732a049fe6671348dbed1.jpg not downloaded yet
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_2efdbd41bd59db8b504c7814d58fc4be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_2efdbd41bd59db8b504c7814d58fc4be.jpg not downloaded yet
2026-03-30 11:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB45577> (referer: https://www.auto1.com/v1/car-details-view/WB45577/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c76ae0d2-4ff1-5b04-a727-19889b1e9b21 with identifier: WB45577
2026-03-30 11:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21 with scrape type 1
2026-03-30 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_be33f5978d682bdea7feba22733dbf2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_be33f5978d682bdea7feba22733dbf2c.jpg not downloaded yet
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_0d3ccae6195288b560b08dedec77b4b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_0d3ccae6195288b560b08dedec77b4b7.jpg not downloaded yet
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_fd711d3752c924e9505b34242b5a28df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_fd711d3752c924e9505b34242b5a28df.jpg not downloaded yet
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_b52aeccf871c6fb9e4d8581083191103.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_b52aeccf871c6fb9e4d8581083191103.jpg not downloaded yet
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_ef6930a52c8e5d9b63d71ae3207d359d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_ef6930a52c8e5d9b63d71ae3207d359d.jpg not downloaded yet
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_f1ba10b0cba8a95e9b9fbedb67e5739c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_f1ba10b0cba8a95e9b9fbedb67e5739c.jpg not downloaded yet
2026-03-30 11:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_2efdbd41bd59db8b504c7814d58fc4be.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662c950>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_2efdbd41bd59db8b504c7814d58fc4be.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_2efdbd41bd59db8b504c7814d58fc4be.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_f1ba10b0cba8a95e9b9fbedb67e5739c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_ef6930a52c8e5d9b63d71ae3207d359d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_b52aeccf871c6fb9e4d8581083191103.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6422c10>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_f1ba10b0cba8a95e9b9fbedb67e5739c.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_f1ba10b0cba8a95e9b9fbedb67e5739c.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_fd711d3752c924e9505b34242b5a28df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6ff6690>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_ef6930a52c8e5d9b63d71ae3207d359d.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_ef6930a52c8e5d9b63d71ae3207d359d.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65cbf90>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_b52aeccf871c6fb9e4d8581083191103.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_b52aeccf871c6fb9e4d8581083191103.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc2269d0>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_fd711d3752c924e9505b34242b5a28df.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_fd711d3752c924e9505b34242b5a28df.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_0d3ccae6195288b560b08dedec77b4b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_be33f5978d682bdea7feba22733dbf2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9510b61e2b4732a049fe6671348dbed1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9a8416034faebc47cf7f84110f406cbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb654a090>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_0d3ccae6195288b560b08dedec77b4b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_0d3ccae6195288b560b08dedec77b4b7.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_84bb173e7c5a86d7b6c6d288d4f29575.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb650a8d0>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F44%252F6444505655c100feaefba9d7c690020f%252Fpa%252FWB45577_be33f5978d682bdea7feba22733dbf2c.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_be33f5978d682bdea7feba22733dbf2c.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21
2026-03-30 11:09:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c76ae0d2-4ff1-5b04-a727-19889b1e9b21, skipping ID generation
2026-03-30 11:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21 with scrape type 1
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c76ae0d2-4ff1-5b04-a727-19889b1e9b21 sending to next pipeline
2026-03-30 11:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c76ae0d2-4ff1-5b04-a727-19889b1e9b21, identifier: WB45577
2026-03-30 11:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c76ae0d2-4ff1-5b04-a727-19889b1e9b21 with identifier: WB45577
2026-03-30 11:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c76ae0d2-4ff1-5b04-a727-19889b1e9b21 with identifier: WB45577
2026-03-30 11:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c76ae0d2-4ff1-5b04-a727-19889b1e9b21 with identifier: WB45577 to the API
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_be33f5978d682bdea7feba22733dbf2c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:01:41Z',
 'fuel_type': 'petrol',
 'id': 'c76ae0d2-4ff1-5b04-a727-19889b1e9b21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB45577',
 'listing': 'auction',
 'location': 'ES, Rubí',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 212761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_be33f5978d682bdea7feba22733dbf2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_0d3ccae6195288b560b08dedec77b4b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_fd711d3752c924e9505b34242b5a28df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_b52aeccf871c6fb9e4d8581083191103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_ef6930a52c8e5d9b63d71ae3207d359d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ae0d2-4ff1-5b04-a727-19889b1e9b21/c76ae0d2-4ff1-5b04-a727-19889b1e9b21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/44/6444505655c100feaefba9d7c690020f/pa/WB45577_f1ba10b0cba8a95e9b9fbedb67e5739c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-01-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 2.0 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2003}
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB45577%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [auto1.es] INFO: Saving data for WB45577: {'created_time': 1774868951.237557, 'last_price_update_time': 1774868951.237569, 'auction_closing_time': 1774969301.0}
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WB45577') HTTP/1.1" 204 0
2026-03-30 11:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ30272> (referer: https://www.auto1.com/v1/car-details-view/GZ30272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_d92cf0a2da17f0974c105020db1fba38.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6420450>
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_9510b61e2b4732a049fe6671348dbed1.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9510b61e2b4732a049fe6671348dbed1.jpg saved to cache
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c3dd0>
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_9a8416034faebc47cf7f84110f406cbe.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9a8416034faebc47cf7f84110f406cbe.jpg saved to cache
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc12abd0>
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_84bb173e7c5a86d7b6c6d288d4f29575.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_84bb173e7c5a86d7b6c6d288d4f29575.jpg saved to cache
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa
2026-03-30 11:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fed2a64-9276-59de-8130-35ebf4041eaa with identifier: GZ30272
2026-03-30 11:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fed2a64-9276-59de-8130-35ebf4041eaa with scrape type 1
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fed2a64-9276-59de-8130-35ebf4041eaa
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_7ff2f0f99b65018387e842d85ea7c463.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_7ff2f0f99b65018387e842d85ea7c463.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_f9aea33fe66e342931c52d74872d8625.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_f9aea33fe66e342931c52d74872d8625.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_725225aab032e4352d0fcc1bd4167b23.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_725225aab032e4352d0fcc1bd4167b23.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_cab02c651b2b710d96defb0cbafcc1be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_cab02c651b2b710d96defb0cbafcc1be.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_b77b82239b3eae55830638c1181fd82d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_b77b82239b3eae55830638c1181fd82d.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_ab38ea054abb4d12cce7a5a7a02907d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_ab38ea054abb4d12cce7a5a7a02907d7.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_df09f5e2b28a0192660da5d3b0ea6b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_df09f5e2b28a0192660da5d3b0ea6b0a.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_f3b83e87efcd4f33b50be8b1c59ee95c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_f3b83e87efcd4f33b50be8b1c59ee95c.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_f2b439f7b182bc898450fcd70d7a321a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_f2b439f7b182bc898450fcd70d7a321a.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Ffe%252F90fe7795d80363a028425eb7afafe88f%252Fpa%252FGZ30272_cf50ceeee1d441724bb63112b019421f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_cf50ceeee1d441724bb63112b019421f.jpg already downloaded
2026-03-30 11:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3fed2a64-9276-59de-8130-35ebf4041eaa, identifier: GZ30272
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb660dbd0>
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_d92cf0a2da17f0974c105020db1fba38.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_d92cf0a2da17f0974c105020db1fba38.jpg saved to cache
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa
2026-03-30 11:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3fed2a64-9276-59de-8130-35ebf4041eaa with identifier: GZ30272
2026-03-30 11:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3fed2a64-9276-59de-8130-35ebf4041eaa with identifier: GZ30272
2026-03-30 11:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3fed2a64-9276-59de-8130-35ebf4041eaa with identifier: GZ30272 to the API
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ30272>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:06:19Z',
 'fuel_type': 'petrol',
 'id': '3fed2a64-9276-59de-8130-35ebf4041eaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ30272',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 217471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_7ff2f0f99b65018387e842d85ea7c463.jpg',
                'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_f9aea33fe66e342931c52d74872d8625.jpg',
                'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_725225aab032e4352d0fcc1bd4167b23.jpg',
                'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_cab02c651b2b710d96defb0cbafcc1be.jpg',
                'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_b77b82239b3eae55830638c1181fd82d.jpg',
                'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_ab38ea054abb4d12cce7a5a7a02907d7.jpg',
                'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_df09f5e2b28a0192660da5d3b0ea6b0a.jpg',
                'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_f3b83e87efcd4f33b50be8b1c59ee95c.jpg',
                'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_f2b439f7b182bc898450fcd70d7a321a.jpg',
                'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_cf50ceeee1d441724bb63112b019421f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_7ff2f0f99b65018387e842d85ea7c463.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_f9aea33fe66e342931c52d74872d8625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_725225aab032e4352d0fcc1bd4167b23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_cab02c651b2b710d96defb0cbafcc1be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_b77b82239b3eae55830638c1181fd82d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_ab38ea054abb4d12cce7a5a7a02907d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_df09f5e2b28a0192660da5d3b0ea6b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_f3b83e87efcd4f33b50be8b1c59ee95c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_f2b439f7b182bc898450fcd70d7a321a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fed2a64-9276-59de-8130-35ebf4041eaa/3fed2a64-9276-59de-8130-35ebf4041eaa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/fe/90fe7795d80363a028425eb7afafe88f/pa/GZ30272_cf50ceeee1d441724bb63112b019421f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ30272%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [auto1.es] INFO: Saving data for GZ30272: {'created_time': 1774868952.03799, 'last_price_update_time': 1774868952.038003, 'auction_closing_time': 1774969579.0}
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GZ30272') HTTP/1.1" 204 0
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_523a20dcc9167c6166010c91458d8f32.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9d1c691f67b948f927546efe38ec9124.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_69791919d608516262f6a493a50d871f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_6e118552c6d596bdee5714504548f62a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_457a25721de814067392d0193f9b3ec6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6566050>
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_523a20dcc9167c6166010c91458d8f32.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_523a20dcc9167c6166010c91458d8f32.jpg saved to cache
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb64017d0>
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee80bef1a7e663454c41f5bb5d42a%252Fpa%252FVY22217_9d1c691f67b948f927546efe38ec9124.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9d1c691f67b948f927546efe38ec9124.jpg saved to cache
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa
2026-03-30 11:09:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa, skipping ID generation
2026-03-30 11:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa with scrape type 1
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa sending to next pipeline
2026-03-30 11:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa, identifier: VY22217
2026-03-30 11:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa with identifier: VY22217
2026-03-30 11:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa with identifier: VY22217
2026-03-30 11:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3b857fa3-c7c8-50ce-8031-4a48c5e06bfa with identifier: VY22217 to the API
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9d1c691f67b948f927546efe38ec9124.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.9L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:50:13Z',
 'fuel_type': 'diesel',
 'id': '3b857fa3-c7c8-50ce-8031-4a48c5e06bfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY22217',
 'listing': 'auction',
 'location': 'ES, Las Lagunas de Mijas',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 177277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9d1c691f67b948f927546efe38ec9124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_d92cf0a2da17f0974c105020db1fba38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_84bb173e7c5a86d7b6c6d288d4f29575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9a8416034faebc47cf7f84110f406cbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_9510b61e2b4732a049fe6671348dbed1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b857fa3-c7c8-50ce-8031-4a48c5e06bfa/3b857fa3-c7c8-50ce-8031-4a48c5e06bfa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee80bef1a7e663454c41f5bb5d42a/pa/VY22217_2efdbd41bd59db8b504c7814d58fc4be.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Sport Rider',
 'transmission': 'manual',
 'trim': 'Sport Rider',
 'year': 2005}
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY22217%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [auto1.es] INFO: Saving data for VY22217: {'created_time': 1774868952.704929, 'last_price_update_time': 1774868952.70494, 'auction_closing_time': 1774972213.0}
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY22217') HTTP/1.1" 204 0
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6586410>
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_69791919d608516262f6a493a50d871f.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_69791919d608516262f6a493a50d871f.jpg saved to cache
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66bfa90>
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_6e118552c6d596bdee5714504548f62a.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_6e118552c6d596bdee5714504548f62a.jpg saved to cache
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66f03d0>
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f3bc800820948ab31824b5d584a981%252Fpa%252FUK20362_457a25721de814067392d0193f9b3ec6.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_457a25721de814067392d0193f9b3ec6.jpg saved to cache
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53
2026-03-30 11:09:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1d7f199-ebae-5b6a-abe0-657d53e6fa53, skipping ID generation
2026-03-30 11:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53 with scrape type 1
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1d7f199-ebae-5b6a-abe0-657d53e6fa53 sending to next pipeline
2026-03-30 11:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1d7f199-ebae-5b6a-abe0-657d53e6fa53, identifier: UK20362
2026-03-30 11:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1d7f199-ebae-5b6a-abe0-657d53e6fa53 with identifier: UK20362
2026-03-30 11:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1d7f199-ebae-5b6a-abe0-657d53e6fa53 with identifier: UK20362
2026-03-30 11:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c1d7f199-ebae-5b6a-abe0-657d53e6fa53 with identifier: UK20362 to the API
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_457a25721de814067392d0193f9b3ec6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:55:57Z',
 'fuel_type': 'diesel',
 'id': 'c1d7f199-ebae-5b6a-abe0-657d53e6fa53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK20362',
 'listing': 'auction',
 'location': 'ES, El Vendrell',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 159849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_457a25721de814067392d0193f9b3ec6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_6e118552c6d596bdee5714504548f62a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_69791919d608516262f6a493a50d871f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_523a20dcc9167c6166010c91458d8f32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_8b4812ac804a2bb5f88b68faca204052.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_d9e63952e602c0364c93ac465d260057.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_aa7711dcf8132ca1e0300b205643ebdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_d58cdc278e632a6683f43742c9ad9412.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_5a64660aaaf5bbb09befdac4aa9fd359.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7f199-ebae-5b6a-abe0-657d53e6fa53/c1d7f199-ebae-5b6a-abe0-657d53e6fa53_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f3bc800820948ab31824b5d584a981/pa/UK20362_77dd617f40f09e21f26b864e65dfead9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK20362%27 HTTP/1.1" 200 None
2026-03-30 11:09:13 [auto1.es] INFO: Saving data for UK20362: {'created_time': 1774868953.536094, 'last_price_update_time': 1774868953.536106, 'auction_closing_time': 1774972557.0}
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UK20362') HTTP/1.1" 204 0
2026-03-30 11:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH73339> (referer: https://www.auto1.com/v1/car-details-view/HH73339/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f084b9e-550d-516e-834f-ff4f614ed1e2 with identifier: HH73339
2026-03-30 11:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f084b9e-550d-516e-834f-ff4f614ed1e2 with scrape type 1
2026-03-30 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2f084b9e-550d-516e-834f-ff4f614ed1e2
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_457e5a3a5d154af1fe9cbcd5d5ad3411.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_457e5a3a5d154af1fe9cbcd5d5ad3411.jpg not downloaded yet
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_e90c7471b55c10bd29b064b60670f758.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_e90c7471b55c10bd29b064b60670f758.jpg not downloaded yet
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_c9c1e0af1a9eebf744e35c4f2d9c1a76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_c9c1e0af1a9eebf744e35c4f2d9c1a76.jpg not downloaded yet
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_0f59083881b6e7db67a0cc1323140703.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_0f59083881b6e7db67a0cc1323140703.jpg not downloaded yet
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_dc0fccc6aa2c0e37fa1905ba351085cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_dc0fccc6aa2c0e37fa1905ba351085cc.jpg not downloaded yet
2026-03-30 11:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_fbac76c7445064c56511cafbba6eb30b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_b1823de4b002f96ab4801f01e3ed9647.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_b1823de4b002f96ab4801f01e3ed9647.jpg not downloaded yet
2026-03-30 11:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662c790>
2026-03-30 11:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_fbac76c7445064c56511cafbba6eb30b.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_fbac76c7445064c56511cafbba6eb30b.jpg saved to cache
2026-03-30 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_dc0fccc6aa2c0e37fa1905ba351085cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb667fed0>
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_dc0fccc6aa2c0e37fa1905ba351085cc.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_dc0fccc6aa2c0e37fa1905ba351085cc.jpg saved to cache
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f084b9e-550d-516e-834f-ff4f614ed1e2
2026-03-30 11:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_b1823de4b002f96ab4801f01e3ed9647.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_0f59083881b6e7db67a0cc1323140703.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662f590>
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_b1823de4b002f96ab4801f01e3ed9647.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_b1823de4b002f96ab4801f01e3ed9647.jpg saved to cache
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f084b9e-550d-516e-834f-ff4f614ed1e2
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6586c50>
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_0f59083881b6e7db67a0cc1323140703.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_0f59083881b6e7db67a0cc1323140703.jpg saved to cache
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f084b9e-550d-516e-834f-ff4f614ed1e2
2026-03-30 11:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_c9c1e0af1a9eebf744e35c4f2d9c1a76.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66bf290>
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_c9c1e0af1a9eebf744e35c4f2d9c1a76.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_c9c1e0af1a9eebf744e35c4f2d9c1a76.jpg saved to cache
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f084b9e-550d-516e-834f-ff4f614ed1e2
2026-03-30 11:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_e90c7471b55c10bd29b064b60670f758.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_457e5a3a5d154af1fe9cbcd5d5ad3411.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb649bad0>
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_e90c7471b55c10bd29b064b60670f758.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_e90c7471b55c10bd29b064b60670f758.jpg saved to cache
2026-03-30 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f084b9e-550d-516e-834f-ff4f614ed1e2
2026-03-30 11:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_6da2f4c443f1f2e42b67b504624d225b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66f38d0>
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a9247a41d9a60e2ea9a95199c74097%252Fpa%252FHH73339_457e5a3a5d154af1fe9cbcd5d5ad3411.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_457e5a3a5d154af1fe9cbcd5d5ad3411.jpg saved to cache
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f084b9e-550d-516e-834f-ff4f614ed1e2
2026-03-30 11:09:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f084b9e-550d-516e-834f-ff4f614ed1e2, skipping ID generation
2026-03-30 11:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f084b9e-550d-516e-834f-ff4f614ed1e2 with scrape type 1
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f084b9e-550d-516e-834f-ff4f614ed1e2 sending to next pipeline
2026-03-30 11:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f084b9e-550d-516e-834f-ff4f614ed1e2, identifier: HH73339
2026-03-30 11:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f084b9e-550d-516e-834f-ff4f614ed1e2 with identifier: HH73339
2026-03-30 11:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f084b9e-550d-516e-834f-ff4f614ed1e2 with identifier: HH73339
2026-03-30 11:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f084b9e-550d-516e-834f-ff4f614ed1e2 with identifier: HH73339 to the API
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_457e5a3a5d154af1fe9cbcd5d5ad3411.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:41:17Z',
 'fuel_type': 'diesel',
 'id': '2f084b9e-550d-516e-834f-ff4f614ed1e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH73339',
 'listing': 'auction',
 'location': 'ES, Alicante',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 149589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_457e5a3a5d154af1fe9cbcd5d5ad3411.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_e90c7471b55c10bd29b064b60670f758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_c9c1e0af1a9eebf744e35c4f2d9c1a76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_0f59083881b6e7db67a0cc1323140703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_dc0fccc6aa2c0e37fa1905ba351085cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f084b9e-550d-516e-834f-ff4f614ed1e2/2f084b9e-550d-516e-834f-ff4f614ed1e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a9247a41d9a60e2ea9a95199c74097/pa/HH73339_b1823de4b002f96ab4801f01e3ed9647.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 307 2.0 HDi XSI',
 'transmission': 'manual',
 'trim': 'XSI',
 'year': 2004}
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH73339%27 HTTP/1.1" 200 None
2026-03-30 11:09:20 [auto1.es] INFO: Saving data for HH73339: {'created_time': 1774868960.433664, 'last_price_update_time': 1774868960.433674, 'auction_closing_time': 1774971677.0}
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HH73339') HTTP/1.1" 204 0
2026-03-30 11:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_3335f3bf3674e4d9866421e7801051a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc6de210>
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_6da2f4c443f1f2e42b67b504624d225b.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_6da2f4c443f1f2e42b67b504624d225b.jpg saved to cache
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbcfa5a50>
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_3335f3bf3674e4d9866421e7801051a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_3335f3bf3674e4d9866421e7801051a1.jpg saved to cache
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_d383c2479e1b6d8955de26cc3d0db62b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_a77acf42a55a985c1a980ac8012e7d66.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd029990>
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_d383c2479e1b6d8955de26cc3d0db62b.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_d383c2479e1b6d8955de26cc3d0db62b.jpg saved to cache
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6408690>
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F04%252Fa404687d4d5ba9705018f9f1dcce0725%252Fpa%252FWS41958_a77acf42a55a985c1a980ac8012e7d66.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_a77acf42a55a985c1a980ac8012e7d66.jpg saved to cache
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4168103f-7162-5299-8264-ce2b21be86cb
2026-03-30 11:09:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4168103f-7162-5299-8264-ce2b21be86cb, skipping ID generation
2026-03-30 11:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4168103f-7162-5299-8264-ce2b21be86cb with scrape type 1
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4168103f-7162-5299-8264-ce2b21be86cb sending to next pipeline
2026-03-30 11:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4168103f-7162-5299-8264-ce2b21be86cb, identifier: WS41958
2026-03-30 11:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4168103f-7162-5299-8264-ce2b21be86cb with identifier: WS41958
2026-03-30 11:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4168103f-7162-5299-8264-ce2b21be86cb with identifier: WS41958
2026-03-30 11:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4168103f-7162-5299-8264-ce2b21be86cb with identifier: WS41958 to the API
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_a77acf42a55a985c1a980ac8012e7d66.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:17:06Z',
 'fuel_type': 'diesel',
 'id': '4168103f-7162-5299-8264-ce2b21be86cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS41958',
 'listing': 'auction',
 'location': 'ES, Almería',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 157137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_a77acf42a55a985c1a980ac8012e7d66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_d383c2479e1b6d8955de26cc3d0db62b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_3335f3bf3674e4d9866421e7801051a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_6da2f4c443f1f2e42b67b504624d225b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_fbac76c7445064c56511cafbba6eb30b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_c7f746213435ef17f81c8989444431cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_7099545f6cc87638e8339068d1c827f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_ec0630a14c295885fcf5ba1a476719c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_c95b802ed7cd34175a14bc1541863c24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4168103f-7162-5299-8264-ce2b21be86cb/4168103f-7162-5299-8264-ce2b21be86cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/04/a404687d4d5ba9705018f9f1dcce0725/pa/WS41958_5d11ce5abe92a37a810420e2ef67fe50.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Selective',
 'transmission': 'automatic',
 'trim': 'Selective',
 'year': 2015}
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS41958%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [auto1.es] INFO: Saving data for WS41958: {'created_time': 1774868961.959296, 'last_price_update_time': 1774868961.959306, 'auction_closing_time': 1774970226.0}
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WS41958') HTTP/1.1" 204 0
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL24407> (referer: https://www.auto1.com/v1/car-details-view/CL24407/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5965a01d-6f67-50f6-a939-c11d38a8060e with identifier: CL24407
2026-03-30 11:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5965a01d-6f67-50f6-a939-c11d38a8060e with scrape type 1
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5965a01d-6f67-50f6-a939-c11d38a8060e
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_a46c1ea6abcffd772fe9b24312691a62.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_a46c1ea6abcffd772fe9b24312691a62.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_87598000dc8995c709acaeaa7ed61875.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_87598000dc8995c709acaeaa7ed61875.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_087799dba8b13140337d122f0d1812fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_087799dba8b13140337d122f0d1812fd.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_2d55f344caf13d20906a8ce369068e84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_2d55f344caf13d20906a8ce369068e84.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_c63e55d8630e8e21a80655eee36f5c3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_c63e55d8630e8e21a80655eee36f5c3b.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_cf6a2b9c5f446305a06a0c6ad01857a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_cf6a2b9c5f446305a06a0c6ad01857a2.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_36f1d05936db4ad47ad23f14df971cbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_36f1d05936db4ad47ad23f14df971cbb.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_cc82fd05a2ba6582a71b8c7ac0c06d28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_cc82fd05a2ba6582a71b8c7ac0c06d28.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_ce86dbc0e3237fea1e5724a97767b6c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_ce86dbc0e3237fea1e5724a97767b6c8.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fe2%252F63e2c4c7f2b4ca48a80d596d6580446a%252Fpa%252FCL24407_f28d5c8e39b5802a3f38cd029050063a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_f28d5c8e39b5802a3f38cd029050063a.jpg already downloaded
2026-03-30 11:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5965a01d-6f67-50f6-a939-c11d38a8060e, identifier: CL24407
2026-03-30 11:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5965a01d-6f67-50f6-a939-c11d38a8060e with identifier: CL24407
2026-03-30 11:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5965a01d-6f67-50f6-a939-c11d38a8060e with identifier: CL24407
2026-03-30 11:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5965a01d-6f67-50f6-a939-c11d38a8060e with identifier: CL24407 to the API
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CL24407>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:23:40Z',
 'fuel_type': 'diesel',
 'id': '5965a01d-6f67-50f6-a939-c11d38a8060e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL24407',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 183285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_a46c1ea6abcffd772fe9b24312691a62.jpg',
                'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_87598000dc8995c709acaeaa7ed61875.jpg',
                'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_087799dba8b13140337d122f0d1812fd.jpg',
                'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_2d55f344caf13d20906a8ce369068e84.jpg',
                'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_c63e55d8630e8e21a80655eee36f5c3b.jpg',
                'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_cf6a2b9c5f446305a06a0c6ad01857a2.jpg',
                'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_36f1d05936db4ad47ad23f14df971cbb.jpg',
                'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_cc82fd05a2ba6582a71b8c7ac0c06d28.jpg',
                'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_ce86dbc0e3237fea1e5724a97767b6c8.jpg',
                'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_f28d5c8e39b5802a3f38cd029050063a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_a46c1ea6abcffd772fe9b24312691a62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_87598000dc8995c709acaeaa7ed61875.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_087799dba8b13140337d122f0d1812fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_2d55f344caf13d20906a8ce369068e84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_c63e55d8630e8e21a80655eee36f5c3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_cf6a2b9c5f446305a06a0c6ad01857a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_36f1d05936db4ad47ad23f14df971cbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_cc82fd05a2ba6582a71b8c7ac0c06d28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_ce86dbc0e3237fea1e5724a97767b6c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5965a01d-6f67-50f6-a939-c11d38a8060e/5965a01d-6f67-50f6-a939-c11d38a8060e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/e2/63e2c4c7f2b4ca48a80d596d6580446a/pa/CL24407_f28d5c8e39b5802a3f38cd029050063a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X6 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL24407%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [auto1.es] INFO: Saving data for CL24407: {'created_time': 1774868962.684606, 'last_price_update_time': 1774868962.684617, 'auction_closing_time': 1774970620.0}
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CL24407') HTTP/1.1" 204 0
2026-03-30 11:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL09237> (referer: https://www.auto1.com/v1/car-details-view/HL09237/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3eb8536-ea01-5363-b986-a145550a11f6 with identifier: HL09237
2026-03-30 11:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3eb8536-ea01-5363-b986-a145550a11f6 with scrape type 1
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_742fb8939a81ab6074c566822a23080e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_742fb8939a81ab6074c566822a23080e.jpg not downloaded yet
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_b55e4435e846cd5318b2e976ab7e64e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_b55e4435e846cd5318b2e976ab7e64e9.jpg not downloaded yet
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_0fcba8cdc16b07ed093cd5206cd66206.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_0fcba8cdc16b07ed093cd5206cd66206.jpg not downloaded yet
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_02bae0d4659f6954f8283e42c849baa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_02bae0d4659f6954f8283e42c849baa2.jpg not downloaded yet
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_7f96372d8d8c0049c5de251591785235.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_7f96372d8d8c0049c5de251591785235.jpg not downloaded yet
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_3a256918bbc890e36d1a5fecd53e0348.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_3a256918bbc890e36d1a5fecd53e0348.jpg not downloaded yet
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_571f019166eae14a27e3662005df6860.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_571f019166eae14a27e3662005df6860.jpg not downloaded yet
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_b7fb4051bdc757b085e756e1af6a84d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_b7fb4051bdc757b085e756e1af6a84d3.jpg not downloaded yet
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_900739a6862fb5f9c02b791da27fb39a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_900739a6862fb5f9c02b791da27fb39a.jpg not downloaded yet
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_2a9e886da2ea0b526b55cab17a26d4e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_2a9e886da2ea0b526b55cab17a26d4e6.jpg not downloaded yet
2026-03-30 11:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV24674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_2a9e886da2ea0b526b55cab17a26d4e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_900739a6862fb5f9c02b791da27fb39a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc276a90>
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_2a9e886da2ea0b526b55cab17a26d4e6.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_2a9e886da2ea0b526b55cab17a26d4e6.jpg saved to cache
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE82406> (referer: https://www.auto1.com/v1/car-details-view/CE82406/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f02a10>
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_900739a6862fb5f9c02b791da27fb39a.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_900739a6862fb5f9c02b791da27fb39a.jpg saved to cache
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429 with identifier: CE82406
2026-03-30 11:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429 with scrape type 1
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_efb7cc313f1159da94444c05b69dbd1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_efb7cc313f1159da94444c05b69dbd1b.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_47a6891603063551dcd55d1da46299f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_47a6891603063551dcd55d1da46299f9.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_de24abe04689f8424d4b2f72765b064c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_de24abe04689f8424d4b2f72765b064c.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_493b2344156224e80b426d0010e79a56.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_493b2344156224e80b426d0010e79a56.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_2d8269a1d982d82ff68e874334c4c3e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_2d8269a1d982d82ff68e874334c4c3e4.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_d7ec22b24bb2c4ebeb61a948b1af0b6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_d7ec22b24bb2c4ebeb61a948b1af0b6f.jpg not downloaded yet
2026-03-30 11:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_b7fb4051bdc757b085e756e1af6a84d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_a2a497b845275d59cb07d45240e0e2d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_a2a497b845275d59cb07d45240e0e2d5.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_1f33955af233523020aa5c3809b30cfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_1f33955af233523020aa5c3809b30cfe.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_fa3cc8de2785f9961f197e1be38cfb7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_fa3cc8de2785f9961f197e1be38cfb7d.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_0ffdf53710341d889d07132928df3bcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_0ffdf53710341d889d07132928df3bcd.jpg not downloaded yet
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6409f90>
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_b7fb4051bdc757b085e756e1af6a84d3.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_b7fb4051bdc757b085e756e1af6a84d3.jpg saved to cache
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_d7ec22b24bb2c4ebeb61a948b1af0b6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f4f950>
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_d7ec22b24bb2c4ebeb61a948b1af0b6f.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_d7ec22b24bb2c4ebeb61a948b1af0b6f.jpg saved to cache
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_0ffdf53710341d889d07132928df3bcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6408290>
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_0ffdf53710341d889d07132928df3bcd.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_0ffdf53710341d889d07132928df3bcd.jpg saved to cache
2026-03-30 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_fa3cc8de2785f9961f197e1be38cfb7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6498dd0>
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_fa3cc8de2785f9961f197e1be38cfb7d.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_fa3cc8de2785f9961f197e1be38cfb7d.jpg saved to cache
2026-03-30 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_1f33955af233523020aa5c3809b30cfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb667d590>
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_1f33955af233523020aa5c3809b30cfe.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_1f33955af233523020aa5c3809b30cfe.jpg saved to cache
2026-03-30 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_a2a497b845275d59cb07d45240e0e2d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb649a150>
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_a2a497b845275d59cb07d45240e0e2d5.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_a2a497b845275d59cb07d45240e0e2d5.jpg saved to cache
2026-03-30 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_2d8269a1d982d82ff68e874334c4c3e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f4f7d0>
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_2d8269a1d982d82ff68e874334c4c3e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_2d8269a1d982d82ff68e874334c4c3e4.jpg saved to cache
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_493b2344156224e80b426d0010e79a56.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_de24abe04689f8424d4b2f72765b064c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f03850>
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_493b2344156224e80b426d0010e79a56.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_493b2344156224e80b426d0010e79a56.jpg saved to cache
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f00d50>
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_de24abe04689f8424d4b2f72765b064c.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_de24abe04689f8424d4b2f72765b064c.jpg saved to cache
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_47a6891603063551dcd55d1da46299f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_efb7cc313f1159da94444c05b69dbd1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_571f019166eae14a27e3662005df6860.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6409e90>
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_47a6891603063551dcd55d1da46299f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_47a6891603063551dcd55d1da46299f9.jpg saved to cache
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_3a256918bbc890e36d1a5fecd53e0348.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6663910>
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa3%252F85a32b76e634fd6afce67b238d378e8b%252Fpa%252FCE82406_efb7cc313f1159da94444c05b69dbd1b.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_efb7cc313f1159da94444c05b69dbd1b.jpg saved to cache
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429
2026-03-30 11:09:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429, skipping ID generation
2026-03-30 11:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429 with scrape type 1
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429 sending to next pipeline
2026-03-30 11:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429, identifier: CE82406
2026-03-30 11:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429 with identifier: CE82406
2026-03-30 11:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429 with identifier: CE82406
2026-03-30 11:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429 with identifier: CE82406 to the API
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_efb7cc313f1159da94444c05b69dbd1b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:14:54Z',
 'fuel_type': 'diesel',
 'id': '7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE82406',
 'listing': 'auction',
 'location': 'ES, Churra (Murcia)',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 144884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_efb7cc313f1159da94444c05b69dbd1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_47a6891603063551dcd55d1da46299f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_de24abe04689f8424d4b2f72765b064c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_493b2344156224e80b426d0010e79a56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_2d8269a1d982d82ff68e874334c4c3e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_d7ec22b24bb2c4ebeb61a948b1af0b6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_a2a497b845275d59cb07d45240e0e2d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_1f33955af233523020aa5c3809b30cfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_fa3cc8de2785f9961f197e1be38cfb7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429/7cf5b5a8-18f9-5ce7-be39-7c0b2d43a429_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a3/85a32b76e634fd6afce67b238d378e8b/pa/CE82406_0ffdf53710341d889d07132928df3bcd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2019}
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE82406%27 HTTP/1.1" 200 None
2026-03-30 11:09:29 [auto1.es] INFO: Saving data for CE82406: {'created_time': 1774868969.200792, 'last_price_update_time': 1774868969.200802, 'auction_closing_time': 1774970094.0}
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CE82406') HTTP/1.1" 204 0
2026-03-30 11:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_7f96372d8d8c0049c5de251591785235.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6555310>
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_571f019166eae14a27e3662005df6860.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_571f019166eae14a27e3662005df6860.jpg saved to cache
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f025d0>
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_3a256918bbc890e36d1a5fecd53e0348.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_3a256918bbc890e36d1a5fecd53e0348.jpg saved to cache
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66f0710>
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_7f96372d8d8c0049c5de251591785235.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_7f96372d8d8c0049c5de251591785235.jpg saved to cache
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_02bae0d4659f6954f8283e42c849baa2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c7a50>
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_02bae0d4659f6954f8283e42c849baa2.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_02bae0d4659f6954f8283e42c849baa2.jpg saved to cache
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_0fcba8cdc16b07ed093cd5206cd66206.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_b55e4435e846cd5318b2e976ab7e64e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_742fb8939a81ab6074c566822a23080e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65853d0>
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_0fcba8cdc16b07ed093cd5206cd66206.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_0fcba8cdc16b07ed093cd5206cd66206.jpg saved to cache
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66c2610>
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_b55e4435e846cd5318b2e976ab7e64e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_b55e4435e846cd5318b2e976ab7e64e9.jpg saved to cache
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc1293d0>
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F65%252F046542f375a9f7a80014db6ce4ba6210%252Fpa%252FHL09237_742fb8939a81ab6074c566822a23080e.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_742fb8939a81ab6074c566822a23080e.jpg saved to cache
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3eb8536-ea01-5363-b986-a145550a11f6
2026-03-30 11:09:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3eb8536-ea01-5363-b986-a145550a11f6, skipping ID generation
2026-03-30 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3eb8536-ea01-5363-b986-a145550a11f6 with scrape type 1
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3eb8536-ea01-5363-b986-a145550a11f6 sending to next pipeline
2026-03-30 11:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d3eb8536-ea01-5363-b986-a145550a11f6, identifier: HL09237
2026-03-30 11:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d3eb8536-ea01-5363-b986-a145550a11f6 with identifier: HL09237
2026-03-30 11:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d3eb8536-ea01-5363-b986-a145550a11f6 with identifier: HL09237
2026-03-30 11:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d3eb8536-ea01-5363-b986-a145550a11f6 with identifier: HL09237 to the API
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_742fb8939a81ab6074c566822a23080e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:16:09Z',
 'fuel_type': 'petrol',
 'id': 'd3eb8536-ea01-5363-b986-a145550a11f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL09237',
 'listing': 'auction',
 'location': 'ES, Finestrat, Alicante',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 73018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_742fb8939a81ab6074c566822a23080e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_b55e4435e846cd5318b2e976ab7e64e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_0fcba8cdc16b07ed093cd5206cd66206.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_02bae0d4659f6954f8283e42c849baa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_7f96372d8d8c0049c5de251591785235.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_3a256918bbc890e36d1a5fecd53e0348.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_571f019166eae14a27e3662005df6860.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_b7fb4051bdc757b085e756e1af6a84d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_900739a6862fb5f9c02b791da27fb39a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eb8536-ea01-5363-b986-a145550a11f6/d3eb8536-ea01-5363-b986-a145550a11f6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/046542f375a9f7a80014db6ce4ba6210/pa/HL09237_2a9e886da2ea0b526b55cab17a26d4e6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Young',
 'transmission': 'manual',
 'trim': 'Young',
 'year': 2007}
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL09237%27 HTTP/1.1" 200 None
2026-03-30 11:09:30 [auto1.es] INFO: Saving data for HL09237: {'created_time': 1774868970.586936, 'last_price_update_time': 1774868970.586946, 'auction_closing_time': 1774970169.0}
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HL09237') HTTP/1.1" 204 0
2026-03-30 11:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK17628> (referer: https://www.auto1.com/v1/car-details-view/TK17628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf16f7f9-8ed6-5993-a248-956ad009852b with identifier: TK17628
2026-03-30 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf16f7f9-8ed6-5993-a248-956ad009852b with scrape type 1
2026-03-30 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf16f7f9-8ed6-5993-a248-956ad009852b
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_641c88d202581220283ce651ee977f06.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_641c88d202581220283ce651ee977f06.jpg already downloaded
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_d302c2bb6b7a8572c01e85720fc1a444.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_d302c2bb6b7a8572c01e85720fc1a444.jpg already downloaded
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_86b2b64bfad9116522878342b637f07d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_86b2b64bfad9116522878342b637f07d.jpg already downloaded
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_3d2fe6e8ca2eaab96913578f4ce18b61.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_3d2fe6e8ca2eaab96913578f4ce18b61.jpg already downloaded
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_44cc9d2d02189601b72e8aa4050e2859.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_44cc9d2d02189601b72e8aa4050e2859.jpg already downloaded
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_7c1986cf398f916b6f7ff4096d326d71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_7c1986cf398f916b6f7ff4096d326d71.jpg already downloaded
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_cc2acec84a38f98f5f6eef7ec96d1e70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_cc2acec84a38f98f5f6eef7ec96d1e70.jpg already downloaded
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_42900bf3f36c251f9b458d90d8faf0c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_42900bf3f36c251f9b458d90d8faf0c7.jpg already downloaded
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_bc47fa9fda1c608838a21cb55bfa91a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_bc47fa9fda1c608838a21cb55bfa91a8.jpg already downloaded
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F90%252F059010e801a6373d1ec4d868d86e9bb3%252Fpa%252FTK17628_175c5a44d055706900ef6098a0b61e30.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_175c5a44d055706900ef6098a0b61e30.jpg already downloaded
2026-03-30 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf16f7f9-8ed6-5993-a248-956ad009852b, identifier: TK17628
2026-03-30 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf16f7f9-8ed6-5993-a248-956ad009852b with identifier: TK17628
2026-03-30 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf16f7f9-8ed6-5993-a248-956ad009852b with identifier: TK17628
2026-03-30 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf16f7f9-8ed6-5993-a248-956ad009852b with identifier: TK17628 to the API
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK17628>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:40:02Z',
 'fuel_type': 'diesel',
 'id': 'cf16f7f9-8ed6-5993-a248-956ad009852b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK17628',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 138390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_641c88d202581220283ce651ee977f06.jpg',
                'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_d302c2bb6b7a8572c01e85720fc1a444.jpg',
                'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_86b2b64bfad9116522878342b637f07d.jpg',
                'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_3d2fe6e8ca2eaab96913578f4ce18b61.jpg',
                'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_44cc9d2d02189601b72e8aa4050e2859.jpg',
                'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_7c1986cf398f916b6f7ff4096d326d71.jpg',
                'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_cc2acec84a38f98f5f6eef7ec96d1e70.jpg',
                'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_42900bf3f36c251f9b458d90d8faf0c7.jpg',
                'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_bc47fa9fda1c608838a21cb55bfa91a8.jpg',
                'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_175c5a44d055706900ef6098a0b61e30.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_641c88d202581220283ce651ee977f06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_d302c2bb6b7a8572c01e85720fc1a444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_86b2b64bfad9116522878342b637f07d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_3d2fe6e8ca2eaab96913578f4ce18b61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_44cc9d2d02189601b72e8aa4050e2859.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_7c1986cf398f916b6f7ff4096d326d71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_cc2acec84a38f98f5f6eef7ec96d1e70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_42900bf3f36c251f9b458d90d8faf0c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_bc47fa9fda1c608838a21cb55bfa91a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf16f7f9-8ed6-5993-a248-956ad009852b/cf16f7f9-8ed6-5993-a248-956ad009852b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/90/059010e801a6373d1ec4d868d86e9bb3/pa/TK17628_175c5a44d055706900ef6098a0b61e30.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota ProAce 1.5 D-4D L1 Kombi',
 'transmission': 'manual',
 'trim': 'L1 Kombi',
 'year': 2021}
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK17628%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [auto1.es] INFO: Saving data for TK17628: {'created_time': 1774868973.592685, 'last_price_update_time': 1774868973.592695, 'auction_closing_time': 1774971602.0}
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TK17628') HTTP/1.1" 204 0
2026-03-30 11:09:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.433(s), this was the 1st time calling it.
2026-03-30 11:09:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.539689285055208 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX58510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU12290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.920(s), this was the 1st time calling it.
2026-03-30 11:09:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.4627996974082107 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:09:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR65980> (referer: https://www.auto1.com/v1/car-details-view/AR65980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52962176-36b6-59ba-82a3-b1a3cc0d7f5b with identifier: AR65980
2026-03-30 11:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52962176-36b6-59ba-82a3-b1a3cc0d7f5b with scrape type 1
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 52962176-36b6-59ba-82a3-b1a3cc0d7f5b
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_27085e6b02f03118dafd8023c6ec115c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_27085e6b02f03118dafd8023c6ec115c.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_15adc230ee05c01880aa19af545db4c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_15adc230ee05c01880aa19af545db4c7.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_9931606c0bec36b4c80f71c95a82af84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_9931606c0bec36b4c80f71c95a82af84.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_a929182256dfe6c28c7b93794fbed737.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_a929182256dfe6c28c7b93794fbed737.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_40ccd1f7d6578185f3822a0f3c41e514.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_40ccd1f7d6578185f3822a0f3c41e514.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_91efa6bc3c06143bd9506ff08e22f9a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_91efa6bc3c06143bd9506ff08e22f9a9.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_b0f0671bed67a6eced7c4800810915ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_b0f0671bed67a6eced7c4800810915ba.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_5d3ae16046b9f20746467e56dc607c26.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_5d3ae16046b9f20746467e56dc607c26.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_e1846bbacb4c6309edbce37fa93e08d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_e1846bbacb4c6309edbce37fa93e08d7.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F3d%252F203d3a52e6c94deaf9bb1917defae9cf%252Fpa%252FAR65980_39da2d02190a2018b81bf9cea1af73a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_39da2d02190a2018b81bf9cea1af73a6.jpg already downloaded
2026-03-30 11:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52962176-36b6-59ba-82a3-b1a3cc0d7f5b, identifier: AR65980
2026-03-30 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52962176-36b6-59ba-82a3-b1a3cc0d7f5b with identifier: AR65980
2026-03-30 11:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52962176-36b6-59ba-82a3-b1a3cc0d7f5b with identifier: AR65980
2026-03-30 11:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 52962176-36b6-59ba-82a3-b1a3cc0d7f5b with identifier: AR65980 to the API
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR65980>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:08:10Z',
 'fuel_type': 'diesel',
 'id': '52962176-36b6-59ba-82a3-b1a3cc0d7f5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR65980',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 164429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_27085e6b02f03118dafd8023c6ec115c.jpg',
                'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_15adc230ee05c01880aa19af545db4c7.jpg',
                'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_9931606c0bec36b4c80f71c95a82af84.jpg',
                'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_a929182256dfe6c28c7b93794fbed737.jpg',
                'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_40ccd1f7d6578185f3822a0f3c41e514.jpg',
                'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_91efa6bc3c06143bd9506ff08e22f9a9.jpg',
                'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_b0f0671bed67a6eced7c4800810915ba.jpg',
                'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_5d3ae16046b9f20746467e56dc607c26.jpg',
                'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_e1846bbacb4c6309edbce37fa93e08d7.jpg',
                'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_39da2d02190a2018b81bf9cea1af73a6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_27085e6b02f03118dafd8023c6ec115c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_15adc230ee05c01880aa19af545db4c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_9931606c0bec36b4c80f71c95a82af84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_a929182256dfe6c28c7b93794fbed737.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_40ccd1f7d6578185f3822a0f3c41e514.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_91efa6bc3c06143bd9506ff08e22f9a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_b0f0671bed67a6eced7c4800810915ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_5d3ae16046b9f20746467e56dc607c26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_e1846bbacb4c6309edbce37fa93e08d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52962176-36b6-59ba-82a3-b1a3cc0d7f5b/52962176-36b6-59ba-82a3-b1a3cc0d7f5b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/3d/203d3a52e6c94deaf9bb1917defae9cf/pa/AR65980_39da2d02190a2018b81bf9cea1af73a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR65980%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [auto1.es] INFO: Saving data for AR65980: {'created_time': 1774868990.754123, 'last_price_update_time': 1774868990.754132, 'auction_closing_time': 1774969690.0}
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AR65980') HTTP/1.1" 204 0
2026-03-30 11:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW24130/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC29009/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK75464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:04 [scrapy.extensions.logstats] INFO: Crawled 125 pages (at 16 pages/min), scraped 165 items (at 11 items/min)
2026-03-30 11:10:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT70526> (referer: https://www.auto1.com/v1/car-details-view/CT70526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfa2262f-9d1b-5135-8b93-ef60c8d667fb with identifier: CT70526
2026-03-30 11:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb with scrape type 1
2026-03-30 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_522666cf1f754be5b29811fa3cb42c0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_522666cf1f754be5b29811fa3cb42c0b.jpg not downloaded yet
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_ca4d8c98491cfd994bbd4311cd2b1692.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_ca4d8c98491cfd994bbd4311cd2b1692.jpg not downloaded yet
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_4d0a95b99dfb8748f0bfb533d1f7f198.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_4d0a95b99dfb8748f0bfb533d1f7f198.jpg not downloaded yet
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_5e29f0dd7e46e38ce6adc9391e66e1dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_5e29f0dd7e46e38ce6adc9391e66e1dd.jpg not downloaded yet
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_514cd4674b0988d5305860fd6ce7c496.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_514cd4674b0988d5305860fd6ce7c496.jpg not downloaded yet
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_3d4fb30c6900f847d1012e772bbc424c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_3d4fb30c6900f847d1012e772bbc424c.jpg not downloaded yet
2026-03-30 11:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_522666cf1f754be5b29811fa3cb42c0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_ca4d8c98491cfd994bbd4311cd2b1692.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc274310>
2026-03-30 11:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_522666cf1f754be5b29811fa3cb42c0b.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_522666cf1f754be5b29811fa3cb42c0b.jpg saved to cache
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb
2026-03-30 11:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_5e29f0dd7e46e38ce6adc9391e66e1dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65b7110>
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_ca4d8c98491cfd994bbd4311cd2b1692.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_ca4d8c98491cfd994bbd4311cd2b1692.jpg saved to cache
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb
2026-03-30 11:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_514cd4674b0988d5305860fd6ce7c496.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_3d4fb30c6900f847d1012e772bbc424c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6499c90>
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_5e29f0dd7e46e38ce6adc9391e66e1dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_5e29f0dd7e46e38ce6adc9391e66e1dd.jpg saved to cache
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb
2026-03-30 11:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_4d0a95b99dfb8748f0bfb533d1f7f198.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66e8790>
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_514cd4674b0988d5305860fd6ce7c496.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_514cd4674b0988d5305860fd6ce7c496.jpg saved to cache
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6510b90>
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_3d4fb30c6900f847d1012e772bbc424c.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_3d4fb30c6900f847d1012e772bbc424c.jpg saved to cache
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662dc90>
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fc3%252F5dc3964730d6a310291a2b2aac94637c%252Fpa%252FCT70526_4d0a95b99dfb8748f0bfb533d1f7f198.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_4d0a95b99dfb8748f0bfb533d1f7f198.jpg saved to cache
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb
2026-03-30 11:10:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfa2262f-9d1b-5135-8b93-ef60c8d667fb, skipping ID generation
2026-03-30 11:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb with scrape type 1
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfa2262f-9d1b-5135-8b93-ef60c8d667fb sending to next pipeline
2026-03-30 11:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dfa2262f-9d1b-5135-8b93-ef60c8d667fb, identifier: CT70526
2026-03-30 11:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dfa2262f-9d1b-5135-8b93-ef60c8d667fb with identifier: CT70526
2026-03-30 11:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dfa2262f-9d1b-5135-8b93-ef60c8d667fb with identifier: CT70526
2026-03-30 11:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dfa2262f-9d1b-5135-8b93-ef60c8d667fb with identifier: CT70526 to the API
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_4d0a95b99dfb8748f0bfb533d1f7f198.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:24:35Z',
 'fuel_type': 'diesel',
 'id': 'dfa2262f-9d1b-5135-8b93-ef60c8d667fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT70526',
 'listing': 'auction',
 'location': 'ES, Tarragona',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 190008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_522666cf1f754be5b29811fa3cb42c0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_ca4d8c98491cfd994bbd4311cd2b1692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_4d0a95b99dfb8748f0bfb533d1f7f198.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_5e29f0dd7e46e38ce6adc9391e66e1dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_514cd4674b0988d5305860fd6ce7c496.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfa2262f-9d1b-5135-8b93-ef60c8d667fb/dfa2262f-9d1b-5135-8b93-ef60c8d667fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/c3/5dc3964730d6a310291a2b2aac94637c/pa/CT70526_3d4fb30c6900f847d1012e772bbc424c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi CRDI Executive',
 'transmission': 'manual',
 'trim': 'CRDI Executive',
 'year': 2005}
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT70526%27 HTTP/1.1" 200 None
2026-03-30 11:10:14 [auto1.es] INFO: Saving data for CT70526: {'created_time': 1774869014.836712, 'last_price_update_time': 1774869014.836725, 'auction_closing_time': 1774970675.0}
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CT70526') HTTP/1.1" 204 0
2026-03-30 11:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX58510> (referer: https://www.auto1.com/v1/car-details-view/DX58510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7944ada0-b40b-5f13-9314-2010e9cb244c with identifier: DX58510
2026-03-30 11:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7944ada0-b40b-5f13-9314-2010e9cb244c with scrape type 1
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7944ada0-b40b-5f13-9314-2010e9cb244c
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff8%252Ff7f8a2a2ef6e06e7d42aeb2d3ad324d7%252Fpa%252FDX58510_edb731df80213d26981f5adee9d734c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_edb731df80213d26981f5adee9d734c9.jpg already downloaded
2026-03-30 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff8%252Ff7f8a2a2ef6e06e7d42aeb2d3ad324d7%252Fpa%252FDX58510_f054e7c0e8ef5e95d72d51c8db0680b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_f054e7c0e8ef5e95d72d51c8db0680b9.jpg already downloaded
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff8%252Ff7f8a2a2ef6e06e7d42aeb2d3ad324d7%252Fpa%252FDX58510_ba87af9b310174f652fd19bf23565cc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_ba87af9b310174f652fd19bf23565cc7.jpg already downloaded
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff8%252Ff7f8a2a2ef6e06e7d42aeb2d3ad324d7%252Fpa%252FDX58510_4a8ae7a5901fcce4e5f71eb04554082d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_4a8ae7a5901fcce4e5f71eb04554082d.jpg already downloaded
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff8%252Ff7f8a2a2ef6e06e7d42aeb2d3ad324d7%252Fpa%252FDX58510_ac8ab487ad3667d80e9dedbe0f91302c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_ac8ab487ad3667d80e9dedbe0f91302c.jpg already downloaded
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff8%252Ff7f8a2a2ef6e06e7d42aeb2d3ad324d7%252Fpa%252FDX58510_70c45ee800cc9378f1092c0a782d81cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_70c45ee800cc9378f1092c0a782d81cb.jpg already downloaded
2026-03-30 11:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7944ada0-b40b-5f13-9314-2010e9cb244c, identifier: DX58510
2026-03-30 11:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7944ada0-b40b-5f13-9314-2010e9cb244c with identifier: DX58510
2026-03-30 11:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7944ada0-b40b-5f13-9314-2010e9cb244c with identifier: DX58510
2026-03-30 11:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7944ada0-b40b-5f13-9314-2010e9cb244c with identifier: DX58510 to the API
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DX58510>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:15:03Z',
 'fuel_type': 'diesel',
 'id': '7944ada0-b40b-5f13-9314-2010e9cb244c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX58510',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 220008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_edb731df80213d26981f5adee9d734c9.jpg',
                'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_f054e7c0e8ef5e95d72d51c8db0680b9.jpg',
                'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_ba87af9b310174f652fd19bf23565cc7.jpg',
                'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_4a8ae7a5901fcce4e5f71eb04554082d.jpg',
                'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_ac8ab487ad3667d80e9dedbe0f91302c.jpg',
                'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_70c45ee800cc9378f1092c0a782d81cb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7944ada0-b40b-5f13-9314-2010e9cb244c/7944ada0-b40b-5f13-9314-2010e9cb244c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_edb731df80213d26981f5adee9d734c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7944ada0-b40b-5f13-9314-2010e9cb244c/7944ada0-b40b-5f13-9314-2010e9cb244c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_f054e7c0e8ef5e95d72d51c8db0680b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7944ada0-b40b-5f13-9314-2010e9cb244c/7944ada0-b40b-5f13-9314-2010e9cb244c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_ba87af9b310174f652fd19bf23565cc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7944ada0-b40b-5f13-9314-2010e9cb244c/7944ada0-b40b-5f13-9314-2010e9cb244c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_4a8ae7a5901fcce4e5f71eb04554082d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7944ada0-b40b-5f13-9314-2010e9cb244c/7944ada0-b40b-5f13-9314-2010e9cb244c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_ac8ab487ad3667d80e9dedbe0f91302c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7944ada0-b40b-5f13-9314-2010e9cb244c/7944ada0-b40b-5f13-9314-2010e9cb244c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f8/f7f8a2a2ef6e06e7d42aeb2d3ad324d7/pa/DX58510_70c45ee800cc9378f1092c0a782d81cb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-12-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.9 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2005}
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX58510%27 HTTP/1.1" 200 None
2026-03-30 11:10:15 [auto1.es] INFO: Saving data for DX58510: {'created_time': 1774869015.68558, 'last_price_update_time': 1774869015.68559, 'auction_closing_time': 1774970103.0}
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DX58510') HTTP/1.1" 204 0
2026-03-30 11:10:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.882(s), this was the 1st time calling it.
2026-03-30 11:10:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.70067744527754 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:10:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.240(s), this was the 1st time calling it.
2026-03-30 11:10:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.228523104163696 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:23 [auto1.es] INFO: Channel: 24h | Page: 10 | totalHits: 2205 | hits on page: 40
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: RV47114
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV47114%27 HTTP/1.1" 200 None
2026-03-30 11:10:23 [auto1.es] INFO: Scrape type for RV47114: 0
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: SN50770
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN50770%27 HTTP/1.1" 200 None
2026-03-30 11:10:23 [auto1.es] INFO: Scrape type for SN50770: 0
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: JL69651
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL69651%27 HTTP/1.1" 200 None
2026-03-30 11:10:23 [auto1.es] INFO: Scrape type for JL69651: 0
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: UE43737
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: UR76299
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR76299%27 HTTP/1.1" 200 None
2026-03-30 11:10:23 [auto1.es] INFO: Scrape type for UR76299: 0
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: CE82406
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE82406%27 HTTP/1.1" 200 None
2026-03-30 11:10:23 [auto1.es] INFO: Scrape type for CE82406: 0
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: CP05375
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP05375%27 HTTP/1.1" 200 None
2026-03-30 11:10:23 [auto1.es] INFO: Scrape type for CP05375: 0
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: FK20395
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: RN17480
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: CB59551
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: AE45269
2026-03-30 11:10:23 [auto1.es] INFO: Found listing with ID: XZ25784
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ25784%27 HTTP/1.1" 200 None
2026-03-30 11:10:23 [auto1.es] INFO: Scrape type for XZ25784: 2
2026-03-30 11:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21c26834-f0f1-5c34-8861-4136c8cce91c with identifier: XZ25784
2026-03-30 11:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21c26834-f0f1-5c34-8861-4136c8cce91c with scrape type 2
2026-03-30 11:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21c26834-f0f1-5c34-8861-4136c8cce91c with scrape type 2
2026-03-30 11:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 21c26834-f0f1-5c34-8861-4136c8cce91c, identifier: XZ25784
2026-03-30 11:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 21c26834-f0f1-5c34-8861-4136c8cce91c with identifier: XZ25784
2026-03-30 11:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 21c26834-f0f1-5c34-8861-4136c8cce91c with identifier: XZ25784
2026-03-30 11:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 21c26834-f0f1-5c34-8861-4136c8cce91c with identifier: XZ25784 to the API
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:35:50Z',
 'fuel_type': 'diesel',
 'id': '21c26834-f0f1-5c34-8861-4136c8cce91c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ25784',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 298162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-24',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ25784%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [auto1.es] INFO: Saving data for XZ25784: {'auction_closing_time': 1774971350.0, 'created_time': 1773432299.842686, 'last_price_update_time': 1774869024.060286}
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ25784') HTTP/1.1" 204 0
2026-03-30 11:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT88703> (referer: https://www.auto1.com/v1/car-details-view/VT88703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:24 [auto1.es] INFO: Found listing with ID: YS57234
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS57234%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [auto1.es] INFO: Scrape type for YS57234: 2
2026-03-30 11:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 483cec69-20e1-509e-888f-333af22ead03 with identifier: YS57234
2026-03-30 11:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483cec69-20e1-509e-888f-333af22ead03 with scrape type 2
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 483cec69-20e1-509e-888f-333af22ead03 with scrape type 2
2026-03-30 11:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 483cec69-20e1-509e-888f-333af22ead03, identifier: YS57234
2026-03-30 11:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 483cec69-20e1-509e-888f-333af22ead03 with identifier: YS57234
2026-03-30 11:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 483cec69-20e1-509e-888f-333af22ead03 with identifier: YS57234
2026-03-30 11:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 483cec69-20e1-509e-888f-333af22ead03 with identifier: YS57234 to the API
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:57:18Z',
 'fuel_type': 'petrol',
 'id': '483cec69-20e1-509e-888f-333af22ead03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS57234',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3 Sportback',
 'odometer': 258071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Audi S3 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS57234%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [auto1.es] INFO: Saving data for YS57234: {'auction_closing_time': 1774972638.0, 'created_time': 1773146455.859729, 'last_price_update_time': 1774869024.652717}
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YS57234') HTTP/1.1" 204 0
2026-03-30 11:10:24 [auto1.es] INFO: Found listing with ID: SY46095
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY46095%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [auto1.es] INFO: Scrape type for SY46095: 1
2026-03-30 11:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91468ee8-1774-5d19-a75f-3aab0ef11d7c with identifier: VT88703
2026-03-30 11:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91468ee8-1774-5d19-a75f-3aab0ef11d7c with scrape type 1
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91468ee8-1774-5d19-a75f-3aab0ef11d7c
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_26f59e7b814e82b319cc2e39b4acd469.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_26f59e7b814e82b319cc2e39b4acd469.jpg already downloaded
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_0dea3da5bb6018f07033b2b6cd52ace3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_0dea3da5bb6018f07033b2b6cd52ace3.jpg already downloaded
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_3e1159e2a8db8ece7935567ca407a189.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_3e1159e2a8db8ece7935567ca407a189.jpg already downloaded
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_f62b65e153b6d21931cdf9e406ddf440.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_f62b65e153b6d21931cdf9e406ddf440.jpg already downloaded
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_d9f1e2d6bf257f4519f62b9632243e48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_d9f1e2d6bf257f4519f62b9632243e48.jpg already downloaded
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_9e7800be1d1d037854dd1c609cd35cbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_9e7800be1d1d037854dd1c609cd35cbf.jpg already downloaded
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_b284dfc01150f3ecb33ab0c997160d71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_b284dfc01150f3ecb33ab0c997160d71.jpg already downloaded
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_8f1d89d507527b6e0e8b5de092ff0a90.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_8f1d89d507527b6e0e8b5de092ff0a90.jpg already downloaded
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_59d99e0906edfdb44895d96ce88d474f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_59d99e0906edfdb44895d96ce88d474f.jpg already downloaded
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c291dd0de47992c7e6c12c9b03550aa%252Fpa%252FVT88703_0ec106c25e8592e1717156db6e306711.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_0ec106c25e8592e1717156db6e306711.jpg already downloaded
2026-03-30 11:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91468ee8-1774-5d19-a75f-3aab0ef11d7c, identifier: VT88703
2026-03-30 11:10:25 [auto1.es] INFO: Found listing with ID: EK27191
2026-03-30 11:10:25 [auto1.es] INFO: Found listing with ID: KM47082
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM47082%27 HTTP/1.1" 200 None
2026-03-30 11:10:25 [auto1.es] INFO: Scrape type for KM47082: 2
2026-03-30 11:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with identifier: KM47082
2026-03-30 11:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with scrape type 2
2026-03-30 11:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with scrape type 2
2026-03-30 11:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 44d621a2-3ad3-5091-b09f-d5e7b4355b49, identifier: KM47082
2026-03-30 11:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91468ee8-1774-5d19-a75f-3aab0ef11d7c with identifier: VT88703
2026-03-30 11:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91468ee8-1774-5d19-a75f-3aab0ef11d7c with identifier: VT88703
2026-03-30 11:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91468ee8-1774-5d19-a75f-3aab0ef11d7c with identifier: VT88703 to the API
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VT88703>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:55:44Z',
 'fuel_type': 'diesel',
 'id': '91468ee8-1774-5d19-a75f-3aab0ef11d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT88703',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'BMW',
 'model': '3er',
 'odometer': 177060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_26f59e7b814e82b319cc2e39b4acd469.jpg',
                'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_0dea3da5bb6018f07033b2b6cd52ace3.jpg',
                'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_3e1159e2a8db8ece7935567ca407a189.jpg',
                'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_f62b65e153b6d21931cdf9e406ddf440.jpg',
                'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_d9f1e2d6bf257f4519f62b9632243e48.jpg',
                'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_9e7800be1d1d037854dd1c609cd35cbf.jpg',
                'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_b284dfc01150f3ecb33ab0c997160d71.jpg',
                'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_8f1d89d507527b6e0e8b5de092ff0a90.jpg',
                'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_59d99e0906edfdb44895d96ce88d474f.jpg',
                'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_0ec106c25e8592e1717156db6e306711.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_26f59e7b814e82b319cc2e39b4acd469.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_0dea3da5bb6018f07033b2b6cd52ace3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_3e1159e2a8db8ece7935567ca407a189.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_f62b65e153b6d21931cdf9e406ddf440.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_d9f1e2d6bf257f4519f62b9632243e48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_9e7800be1d1d037854dd1c609cd35cbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_b284dfc01150f3ecb33ab0c997160d71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_8f1d89d507527b6e0e8b5de092ff0a90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_59d99e0906edfdb44895d96ce88d474f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91468ee8-1774-5d19-a75f-3aab0ef11d7c/91468ee8-1774-5d19-a75f-3aab0ef11d7c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c291dd0de47992c7e6c12c9b03550aa/pa/VT88703_0ec106c25e8592e1717156db6e306711.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT88703%27 HTTP/1.1" 200 None
2026-03-30 11:10:25 [auto1.es] INFO: Saving data for VT88703: {'created_time': 1774869025.485408, 'last_price_update_time': 1774869025.485421, 'auction_closing_time': 1774972544.0}
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT88703') HTTP/1.1" 204 0
2026-03-30 11:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with identifier: KM47082
2026-03-30 11:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with identifier: KM47082
2026-03-30 11:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with identifier: KM47082 to the API
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 344,
 'expiration_date': '2026-03-31T15:57:44Z',
 'fuel_type': 'diesel',
 'id': '44d621a2-3ad3-5091-b09f-d5e7b4355b49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM47082',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 63899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-21',
 'seller_name': None,
 'title': 'Audi S6 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM47082%27 HTTP/1.1" 200 None
2026-03-30 11:10:25 [auto1.es] INFO: Saving data for KM47082: {'auction_closing_time': 1774972664.0, 'created_time': 1774609372.637448, 'last_price_update_time': 1774869025.80174}
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KM47082') HTTP/1.1" 204 0
2026-03-30 11:10:25 [auto1.es] INFO: Found listing with ID: JU86611
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU86611%27 HTTP/1.1" 200 None
2026-03-30 11:10:25 [auto1.es] INFO: Scrape type for JU86611: 1
2026-03-30 11:10:25 [auto1.es] INFO: Found listing with ID: UC18876
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC18876%27 HTTP/1.1" 200 None
2026-03-30 11:10:25 [auto1.es] INFO: Scrape type for UC18876: 2
2026-03-30 11:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77bc040e-36ce-5ca7-840c-ac2d808d8ca9 with identifier: UC18876
2026-03-30 11:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77bc040e-36ce-5ca7-840c-ac2d808d8ca9 with scrape type 2
2026-03-30 11:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77bc040e-36ce-5ca7-840c-ac2d808d8ca9 with scrape type 2
2026-03-30 11:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 77bc040e-36ce-5ca7-840c-ac2d808d8ca9, identifier: UC18876
2026-03-30 11:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 77bc040e-36ce-5ca7-840c-ac2d808d8ca9 with identifier: UC18876
2026-03-30 11:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 77bc040e-36ce-5ca7-840c-ac2d808d8ca9 with identifier: UC18876
2026-03-30 11:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 77bc040e-36ce-5ca7-840c-ac2d808d8ca9 with identifier: UC18876 to the API
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:00:58Z',
 'fuel_type': 'diesel',
 'id': '77bc040e-36ce-5ca7-840c-ac2d808d8ca9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC18876',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 214900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-05',
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC18876%27 HTTP/1.1" 200 None
2026-03-30 11:10:26 [auto1.es] INFO: Saving data for UC18876: {'auction_closing_time': 1774969258.0, 'created_time': 1773129516.299547, 'last_price_update_time': 1774869026.281675}
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UC18876') HTTP/1.1" 204 0
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: XC17897
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: MR71351
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: JT99347
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: LT09027
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LT09027%27 HTTP/1.1" 200 None
2026-03-30 11:10:26 [auto1.es] INFO: Scrape type for LT09027: 1
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: FL34882
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL34882%27 HTTP/1.1" 200 None
2026-03-30 11:10:26 [auto1.es] INFO: Scrape type for FL34882: 2
2026-03-30 11:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03842bd3-3682-5abc-8e98-ce0b2afc81e8 with identifier: FL34882
2026-03-30 11:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03842bd3-3682-5abc-8e98-ce0b2afc81e8 with scrape type 2
2026-03-30 11:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03842bd3-3682-5abc-8e98-ce0b2afc81e8 with scrape type 2
2026-03-30 11:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 03842bd3-3682-5abc-8e98-ce0b2afc81e8, identifier: FL34882
2026-03-30 11:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 03842bd3-3682-5abc-8e98-ce0b2afc81e8 with identifier: FL34882
2026-03-30 11:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 03842bd3-3682-5abc-8e98-ce0b2afc81e8 with identifier: FL34882
2026-03-30 11:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 03842bd3-3682-5abc-8e98-ce0b2afc81e8 with identifier: FL34882 to the API
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:57:05Z',
 'fuel_type': 'diesel',
 'id': '03842bd3-3682-5abc-8e98-ce0b2afc81e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL34882',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 204190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-22',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.6 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2015}
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL34882%27 HTTP/1.1" 200 None
2026-03-30 11:10:26 [auto1.es] INFO: Saving data for FL34882: {'auction_closing_time': 1774972625.0, 'created_time': 1774382644.020383, 'last_price_update_time': 1774869026.702867}
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FL34882') HTTP/1.1" 204 0
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: RN16192
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN16192%27 HTTP/1.1" 200 None
2026-03-30 11:10:26 [auto1.es] INFO: Scrape type for RN16192: 1
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: GV45247
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: XP89037
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: HM27570
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: TE09393
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: XM49513
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: PC53610
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: KJ27740
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: KF41905
2026-03-30 11:10:26 [auto1.es] INFO: Found listing with ID: AL28647
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL28647%27 HTTP/1.1" 200 None
2026-03-30 11:10:26 [auto1.es] INFO: Scrape type for AL28647: 2
2026-03-30 11:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with identifier: AL28647
2026-03-30 11:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with scrape type 2
2026-03-30 11:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with scrape type 2
2026-03-30 11:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f, identifier: AL28647
2026-03-30 11:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW24130> (referer: https://www.auto1.com/v1/car-details-view/CW24130/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with identifier: AL28647
2026-03-30 11:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with identifier: AL28647
2026-03-30 11:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with identifier: AL28647 to the API
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:58:07Z',
 'fuel_type': 'diesel',
 'id': '6362e0ac-fcb2-5541-9de0-c0edf7c5832f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL28647',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 298819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-02',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL28647%27 HTTP/1.1" 200 None
2026-03-30 11:10:27 [auto1.es] INFO: Saving data for AL28647: {'auction_closing_time': 1774972687.0, 'created_time': 1773691459.682559, 'last_price_update_time': 1774869027.262329}
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AL28647') HTTP/1.1" 204 0
2026-03-30 11:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:27 [auto1.es] INFO: Found listing with ID: YY88672
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY88672%27 HTTP/1.1" 200 None
2026-03-30 11:10:27 [auto1.es] INFO: Scrape type for YY88672: 1
2026-03-30 11:10:27 [auto1.es] INFO: Found listing with ID: FJ13099
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ13099%27 HTTP/1.1" 200 None
2026-03-30 11:10:27 [auto1.es] INFO: Scrape type for FJ13099: 2
2026-03-30 11:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88ee5aab-fb2c-5085-9f6c-fa16b1e75ba8 with identifier: FJ13099
2026-03-30 11:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88ee5aab-fb2c-5085-9f6c-fa16b1e75ba8 with scrape type 2
2026-03-30 11:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88ee5aab-fb2c-5085-9f6c-fa16b1e75ba8 with scrape type 2
2026-03-30 11:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88ee5aab-fb2c-5085-9f6c-fa16b1e75ba8, identifier: FJ13099
2026-03-30 11:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88ee5aab-fb2c-5085-9f6c-fa16b1e75ba8 with identifier: FJ13099
2026-03-30 11:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88ee5aab-fb2c-5085-9f6c-fa16b1e75ba8 with identifier: FJ13099
2026-03-30 11:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88ee5aab-fb2c-5085-9f6c-fa16b1e75ba8 with identifier: FJ13099 to the API
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:54:53Z',
 'fuel_type': 'diesel',
 'id': '88ee5aab-fb2c-5085-9f6c-fa16b1e75ba8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ13099',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 346097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-31',
 'seller_name': None,
 'title': 'Renault Espace 2.0 dCi Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2007}
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ13099%27 HTTP/1.1" 200 None
2026-03-30 11:10:27 [auto1.es] INFO: Saving data for FJ13099: {'auction_closing_time': 1774972493.0, 'created_time': 1773127063.677252, 'last_price_update_time': 1774869027.753101}
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FJ13099') HTTP/1.1" 204 0
2026-03-30 11:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c6f6a05-29b8-53e3-aea4-c245496d13a2 with identifier: CW24130
2026-03-30 11:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2 with scrape type 1
2026-03-30 11:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_1924cb23607ad604cff631460c17dbae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_1924cb23607ad604cff631460c17dbae.jpg not downloaded yet
2026-03-30 11:10:27 [auto1.es] INFO: Found listing with ID: AE25317
2026-03-30 11:10:27 [auto1.es] INFO: Found listing with ID: KS42961
2026-03-30 11:10:27 [auto1.es] INFO: Found listing with ID: NF92534
2026-03-30 11:10:27 [auto1.es] INFO: Found listing with ID: CG52866
2026-03-30 11:10:27 [auto1.es] INFO: Found listing with ID: GU22619
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU22619%27 HTTP/1.1" 200 None
2026-03-30 11:10:27 [auto1.es] INFO: Scrape type for GU22619: 1
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_81ede40d4dbd8edc068f7850443fef99.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_81ede40d4dbd8edc068f7850443fef99.jpg not downloaded yet
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_422282d0ebefe946d046bb42338f441b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_422282d0ebefe946d046bb42338f441b.jpg not downloaded yet
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_2f52136b90b77ae7e67bf76a36847cd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_2f52136b90b77ae7e67bf76a36847cd4.jpg not downloaded yet
2026-03-30 11:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_1924cb23607ad604cff631460c17dbae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_85df93f2af44b855940788b5ff592982.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_85df93f2af44b855940788b5ff592982.jpg not downloaded yet
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_4ec26e08cc5f1080445f17180e10b89d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_4ec26e08cc5f1080445f17180e10b89d.jpg not downloaded yet
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_578b6e989ee554efa53eb72940a3eac5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_578b6e989ee554efa53eb72940a3eac5.jpg not downloaded yet
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_596d85b5f44c05fc1e05c5bdc3487484.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_596d85b5f44c05fc1e05c5bdc3487484.jpg not downloaded yet
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_3689900420abcb1d9922a2bd6b898105.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_3689900420abcb1d9922a2bd6b898105.jpg not downloaded yet
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_4027fce2ccacce8112b829bf69062847.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_4027fce2ccacce8112b829bf69062847.jpg not downloaded yet
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb656fa50>
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_1924cb23607ad604cff631460c17dbae.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_1924cb23607ad604cff631460c17dbae.jpg saved to cache
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_2f52136b90b77ae7e67bf76a36847cd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66012d0>
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_2f52136b90b77ae7e67bf76a36847cd4.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_2f52136b90b77ae7e67bf76a36847cd4.jpg saved to cache
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_4027fce2ccacce8112b829bf69062847.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f4f8d0>
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_4027fce2ccacce8112b829bf69062847.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_4027fce2ccacce8112b829bf69062847.jpg saved to cache
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_3689900420abcb1d9922a2bd6b898105.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb64244d0>
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_3689900420abcb1d9922a2bd6b898105.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_3689900420abcb1d9922a2bd6b898105.jpg saved to cache
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_596d85b5f44c05fc1e05c5bdc3487484.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f19c10>
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_596d85b5f44c05fc1e05c5bdc3487484.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_596d85b5f44c05fc1e05c5bdc3487484.jpg saved to cache
2026-03-30 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_578b6e989ee554efa53eb72940a3eac5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6427c50>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_578b6e989ee554efa53eb72940a3eac5.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_578b6e989ee554efa53eb72940a3eac5.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC29009> (referer: https://www.auto1.com/v1/car-details-view/WC29009/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_4ec26e08cc5f1080445f17180e10b89d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff with identifier: WC29009
2026-03-30 11:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff with scrape type 1
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_220b967b64dd5b4e5a05ab41cd251ffe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_220b967b64dd5b4e5a05ab41cd251ffe.jpg not downloaded yet
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_f4327e87fdeed861747a62043a840d24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_f4327e87fdeed861747a62043a840d24.jpg not downloaded yet
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_20504fe6db261e777e71b9ad3aa3af4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_20504fe6db261e777e71b9ad3aa3af4c.jpg not downloaded yet
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc2776d0>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_4ec26e08cc5f1080445f17180e10b89d.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_4ec26e08cc5f1080445f17180e10b89d.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_09b6cc180a012a885cead4bbcfcd9c0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_09b6cc180a012a885cead4bbcfcd9c0d.jpg not downloaded yet
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_422282d0ebefe946d046bb42338f441b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_26f2212a5e48d4db5812396236654e8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_26f2212a5e48d4db5812396236654e8e.jpg not downloaded yet
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_c5d9fa3aa82fe91d7a999e1fc8045708.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_c5d9fa3aa82fe91d7a999e1fc8045708.jpg not downloaded yet
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_85df93f2af44b855940788b5ff592982.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_e4113c8c49ab2a55a5bc3a2de3acbe77.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_e4113c8c49ab2a55a5bc3a2de3acbe77.jpg not downloaded yet
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_e42c42fd1fd912f7bbd8e882de0afd9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_e42c42fd1fd912f7bbd8e882de0afd9f.jpg not downloaded yet
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_a4c1f6d197d9cf7e634f6c0b7dce523c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_a4c1f6d197d9cf7e634f6c0b7dce523c.jpg not downloaded yet
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_20504fe6db261e777e71b9ad3aa3af4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_aa4e13fa1e92e053ae365f46f1abf91e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_aa4e13fa1e92e053ae365f46f1abf91e.jpg not downloaded yet
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd3e4c10>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_422282d0ebefe946d046bb42338f441b.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_422282d0ebefe946d046bb42338f441b.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb650ebd0>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_85df93f2af44b855940788b5ff592982.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_85df93f2af44b855940788b5ff592982.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66a4ed0>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_20504fe6db261e777e71b9ad3aa3af4c.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_20504fe6db261e777e71b9ad3aa3af4c.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_a4c1f6d197d9cf7e634f6c0b7dce523c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_c5d9fa3aa82fe91d7a999e1fc8045708.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd2d7cd0>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_a4c1f6d197d9cf7e634f6c0b7dce523c.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_a4c1f6d197d9cf7e634f6c0b7dce523c.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb649bfd0>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_c5d9fa3aa82fe91d7a999e1fc8045708.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_c5d9fa3aa82fe91d7a999e1fc8045708.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_aa4e13fa1e92e053ae365f46f1abf91e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_e42c42fd1fd912f7bbd8e882de0afd9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_e4113c8c49ab2a55a5bc3a2de3acbe77.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_09b6cc180a012a885cead4bbcfcd9c0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66a5150>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_aa4e13fa1e92e053ae365f46f1abf91e.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_aa4e13fa1e92e053ae365f46f1abf91e.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66ad850>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_e42c42fd1fd912f7bbd8e882de0afd9f.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_e42c42fd1fd912f7bbd8e882de0afd9f.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_f4327e87fdeed861747a62043a840d24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_26f2212a5e48d4db5812396236654e8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb643d0d0>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_e4113c8c49ab2a55a5bc3a2de3acbe77.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_e4113c8c49ab2a55a5bc3a2de3acbe77.jpg saved to cache
2026-03-30 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66ad250>
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_09b6cc180a012a885cead4bbcfcd9c0d.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_09b6cc180a012a885cead4bbcfcd9c0d.jpg saved to cache
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_220b967b64dd5b4e5a05ab41cd251ffe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb662d190>
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_f4327e87fdeed861747a62043a840d24.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_f4327e87fdeed861747a62043a840d24.jpg saved to cache
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc241e90>
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_26f2212a5e48d4db5812396236654e8e.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_26f2212a5e48d4db5812396236654e8e.jpg saved to cache
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fb2610>
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fb6%252F20b6a1437106b5dabca3da6c069a054a%252Fpa%252FWC29009_220b967b64dd5b4e5a05ab41cd251ffe.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_220b967b64dd5b4e5a05ab41cd251ffe.jpg saved to cache
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff
2026-03-30 11:10:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff, skipping ID generation
2026-03-30 11:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff with scrape type 1
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff sending to next pipeline
2026-03-30 11:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff, identifier: WC29009
2026-03-30 11:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff with identifier: WC29009
2026-03-30 11:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff with identifier: WC29009
2026-03-30 11:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff with identifier: WC29009 to the API
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_220b967b64dd5b4e5a05ab41cd251ffe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:29:39Z',
 'fuel_type': 'diesel',
 'id': '5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC29009',
 'listing': 'auction',
 'location': 'ES, Vélez-Málaga',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 293386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_220b967b64dd5b4e5a05ab41cd251ffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_f4327e87fdeed861747a62043a840d24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_20504fe6db261e777e71b9ad3aa3af4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_09b6cc180a012a885cead4bbcfcd9c0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_26f2212a5e48d4db5812396236654e8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_c5d9fa3aa82fe91d7a999e1fc8045708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_e4113c8c49ab2a55a5bc3a2de3acbe77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_e42c42fd1fd912f7bbd8e882de0afd9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_a4c1f6d197d9cf7e634f6c0b7dce523c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff/5cdd8e1d-c4e0-57bf-9d93-0f1954f43eff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/b6/20b6a1437106b5dabca3da6c069a054a/pa/WC29009_aa4e13fa1e92e053ae365f46f1abf91e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Drive 2WD',
 'transmission': 'manual',
 'trim': 'Drive 2WD',
 'year': 2016}
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC29009%27 HTTP/1.1" 200 None
2026-03-30 11:10:30 [auto1.es] INFO: Saving data for WC29009: {'created_time': 1774869030.707152, 'last_price_update_time': 1774869030.707162, 'auction_closing_time': 1774970979.0}
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WC29009') HTTP/1.1" 204 0
2026-03-30 11:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_81ede40d4dbd8edc068f7850443fef99.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc0d7110>
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F41%252Fe441a338f81d71b3aba8131d86952c13%252Fpa%252FCW24130_81ede40d4dbd8edc068f7850443fef99.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_81ede40d4dbd8edc068f7850443fef99.jpg saved to cache
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2
2026-03-30 11:10:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c6f6a05-29b8-53e3-aea4-c245496d13a2, skipping ID generation
2026-03-30 11:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2 with scrape type 1
2026-03-30 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c6f6a05-29b8-53e3-aea4-c245496d13a2 sending to next pipeline
2026-03-30 11:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6c6f6a05-29b8-53e3-aea4-c245496d13a2, identifier: CW24130
2026-03-30 11:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6c6f6a05-29b8-53e3-aea4-c245496d13a2 with identifier: CW24130
2026-03-30 11:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6c6f6a05-29b8-53e3-aea4-c245496d13a2 with identifier: CW24130
2026-03-30 11:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6c6f6a05-29b8-53e3-aea4-c245496d13a2 with identifier: CW24130 to the API
2026-03-30 11:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_81ede40d4dbd8edc068f7850443fef99.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '3.5L',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:48:23Z',
 'fuel_type': 'petrol',
 'id': '6c6f6a05-29b8-53e3-aea4-c245496d13a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW24130',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 220522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_1924cb23607ad604cff631460c17dbae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_81ede40d4dbd8edc068f7850443fef99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_422282d0ebefe946d046bb42338f441b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_2f52136b90b77ae7e67bf76a36847cd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_85df93f2af44b855940788b5ff592982.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_4ec26e08cc5f1080445f17180e10b89d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_578b6e989ee554efa53eb72940a3eac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_596d85b5f44c05fc1e05c5bdc3487484.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_3689900420abcb1d9922a2bd6b898105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6f6a05-29b8-53e3-aea4-c245496d13a2/6c6f6a05-29b8-53e3-aea4-c245496d13a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/41/e441a338f81d71b3aba8131d86952c13/pa/CW24130_4027fce2ccacce8112b829bf69062847.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-05-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW24130%27 HTTP/1.1" 200 None
2026-03-30 11:10:31 [auto1.es] INFO: Saving data for CW24130: {'created_time': 1774869031.642733, 'last_price_update_time': 1774869031.642746, 'auction_closing_time': 1774972103.0}
2026-03-30 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CW24130') HTTP/1.1" 204 0
2026-03-30 11:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV24674> (referer: https://www.auto1.com/v1/car-details-view/SV24674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52a02eeb-ceac-5d46-a48a-1e4333cd9c51 with identifier: SV24674
2026-03-30 11:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51 with scrape type 1
2026-03-30 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51
2026-03-30 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_3f680c3c8b45db060133fc9a18ef1ae5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_3f680c3c8b45db060133fc9a18ef1ae5.jpg not downloaded yet
2026-03-30 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_b7db89c271b8413ba9a8ea42f0d720f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_b7db89c271b8413ba9a8ea42f0d720f2.jpg not downloaded yet
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_c62a16ab441a50b4da80bf642af7f514.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_c62a16ab441a50b4da80bf642af7f514.jpg not downloaded yet
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_e925d7a648afd919cc6d2fb4a60abf87.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_e925d7a648afd919cc6d2fb4a60abf87.jpg not downloaded yet
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_a1aa151151c66538700ea8ab1fc51f23.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_a1aa151151c66538700ea8ab1fc51f23.jpg not downloaded yet
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_b053e02bee70f0dbc1ec847ad1fb1bcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_b053e02bee70f0dbc1ec847ad1fb1bcc.jpg not downloaded yet
2026-03-30 11:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_3f680c3c8b45db060133fc9a18ef1ae5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_b7db89c271b8413ba9a8ea42f0d720f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_c62a16ab441a50b4da80bf642af7f514.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_e925d7a648afd919cc6d2fb4a60abf87.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_a1aa151151c66538700ea8ab1fc51f23.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc0d4b90>
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_3f680c3c8b45db060133fc9a18ef1ae5.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_3f680c3c8b45db060133fc9a18ef1ae5.jpg saved to cache
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6498b50>
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_b7db89c271b8413ba9a8ea42f0d720f2.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_b7db89c271b8413ba9a8ea42f0d720f2.jpg saved to cache
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fca310>
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_c62a16ab441a50b4da80bf642af7f514.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_c62a16ab441a50b4da80bf642af7f514.jpg saved to cache
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6659710>
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_e925d7a648afd919cc6d2fb4a60abf87.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_e925d7a648afd919cc6d2fb4a60abf87.jpg saved to cache
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6420b10>
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_a1aa151151c66538700ea8ab1fc51f23.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_a1aa151151c66538700ea8ab1fc51f23.jpg saved to cache
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51
2026-03-30 11:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_b053e02bee70f0dbc1ec847ad1fb1bcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66e5390>
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F8a%252F0f8ad0c915cc71e8813bd92911ec16dd%252Fpa%252FSV24674_b053e02bee70f0dbc1ec847ad1fb1bcc.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_b053e02bee70f0dbc1ec847ad1fb1bcc.jpg saved to cache
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51
2026-03-30 11:10:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52a02eeb-ceac-5d46-a48a-1e4333cd9c51, skipping ID generation
2026-03-30 11:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51 with scrape type 1
2026-03-30 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52a02eeb-ceac-5d46-a48a-1e4333cd9c51 sending to next pipeline
2026-03-30 11:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52a02eeb-ceac-5d46-a48a-1e4333cd9c51, identifier: SV24674
2026-03-30 11:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52a02eeb-ceac-5d46-a48a-1e4333cd9c51 with identifier: SV24674
2026-03-30 11:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52a02eeb-ceac-5d46-a48a-1e4333cd9c51 with identifier: SV24674
2026-03-30 11:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 52a02eeb-ceac-5d46-a48a-1e4333cd9c51 with identifier: SV24674 to the API
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_b053e02bee70f0dbc1ec847ad1fb1bcc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:28:12Z',
 'fuel_type': 'petrol',
 'id': '52a02eeb-ceac-5d46-a48a-1e4333cd9c51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV24674',
 'listing': 'auction',
 'location': 'ES, Gandía',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 95853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_3f680c3c8b45db060133fc9a18ef1ae5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_b7db89c271b8413ba9a8ea42f0d720f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_c62a16ab441a50b4da80bf642af7f514.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_e925d7a648afd919cc6d2fb4a60abf87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_a1aa151151c66538700ea8ab1fc51f23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52a02eeb-ceac-5d46-a48a-1e4333cd9c51/52a02eeb-ceac-5d46-a48a-1e4333cd9c51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/8a/0f8ad0c915cc71e8813bd92911ec16dd/pa/SV24674_b053e02bee70f0dbc1ec847ad1fb1bcc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2005}
2026-03-30 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV24674%27 HTTP/1.1" 200 None
2026-03-30 11:10:37 [auto1.es] INFO: Saving data for SV24674: {'created_time': 1774869037.113297, 'last_price_update_time': 1774869037.113309, 'auction_closing_time': 1774970892.0}
2026-03-30 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SV24674') HTTP/1.1" 204 0
2026-03-30 11:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:38 [auto1.es] INFO: Channel: 24h | Page: 11 | totalHits: 2205 | hits on page: 40
2026-03-30 11:10:38 [auto1.es] INFO: Found listing with ID: FR20157
2026-03-30 11:10:38 [auto1.es] INFO: Found listing with ID: ZA02456
2026-03-30 11:10:38 [auto1.es] INFO: Found listing with ID: KM07584
2026-03-30 11:10:38 [auto1.es] INFO: Found listing with ID: KN50238
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN50238%27 HTTP/1.1" 200 None
2026-03-30 11:10:38 [auto1.es] INFO: Scrape type for KN50238: 2
2026-03-30 11:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 704ef20e-662e-5ad1-8c6a-5b8c37aac1e7 with identifier: KN50238
2026-03-30 11:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 704ef20e-662e-5ad1-8c6a-5b8c37aac1e7 with scrape type 2
2026-03-30 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 704ef20e-662e-5ad1-8c6a-5b8c37aac1e7 with scrape type 2
2026-03-30 11:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 704ef20e-662e-5ad1-8c6a-5b8c37aac1e7, identifier: KN50238
2026-03-30 11:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 704ef20e-662e-5ad1-8c6a-5b8c37aac1e7 with identifier: KN50238
2026-03-30 11:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 704ef20e-662e-5ad1-8c6a-5b8c37aac1e7 with identifier: KN50238
2026-03-30 11:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 704ef20e-662e-5ad1-8c6a-5b8c37aac1e7 with identifier: KN50238 to the API
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:26:08Z',
 'fuel_type': 'petrol',
 'id': '704ef20e-662e-5ad1-8c6a-5b8c37aac1e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN50238',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 123669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-25',
 'seller_name': None,
 'title': 'Renault Captur 0.9 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2013}
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN50238%27 HTTP/1.1" 200 None
2026-03-30 11:10:38 [auto1.es] INFO: Saving data for KN50238: {'auction_closing_time': 1774970768.0, 'created_time': 1773669772.339312, 'last_price_update_time': 1774869038.702963}
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KN50238') HTTP/1.1" 204 0
2026-03-30 11:10:38 [auto1.es] INFO: Found listing with ID: DG01155
2026-03-30 11:10:38 [auto1.es] INFO: Found listing with ID: PM66959
2026-03-30 11:10:38 [auto1.es] INFO: Found listing with ID: VU06116
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU06116%27 HTTP/1.1" 200 None
2026-03-30 11:10:38 [auto1.es] INFO: Scrape type for VU06116: 2
2026-03-30 11:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19249b09-9c4d-5be6-9884-b3a5b6e7edcb with identifier: VU06116
2026-03-30 11:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19249b09-9c4d-5be6-9884-b3a5b6e7edcb with scrape type 2
2026-03-30 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19249b09-9c4d-5be6-9884-b3a5b6e7edcb with scrape type 2
2026-03-30 11:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 19249b09-9c4d-5be6-9884-b3a5b6e7edcb, identifier: VU06116
2026-03-30 11:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 19249b09-9c4d-5be6-9884-b3a5b6e7edcb with identifier: VU06116
2026-03-30 11:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 19249b09-9c4d-5be6-9884-b3a5b6e7edcb with identifier: VU06116
2026-03-30 11:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 19249b09-9c4d-5be6-9884-b3a5b6e7edcb with identifier: VU06116 to the API
2026-03-30 11:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:07:59Z',
 'fuel_type': 'diesel',
 'id': '19249b09-9c4d-5be6-9884-b3a5b6e7edcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU06116',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 126268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2009}
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU06116%27 HTTP/1.1" 200 None
2026-03-30 11:10:39 [auto1.es] INFO: Saving data for VU06116: {'auction_closing_time': 1774969679.0, 'created_time': 1774296149.983216, 'last_price_update_time': 1774869039.185746}
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VU06116') HTTP/1.1" 204 0
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: BS90699
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS90699%27 HTTP/1.1" 200 None
2026-03-30 11:10:39 [auto1.es] INFO: Scrape type for BS90699: 1
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: ZL43792
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: LE48212
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: ZL36103
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL36103%27 HTTP/1.1" 200 None
2026-03-30 11:10:39 [auto1.es] INFO: Scrape type for ZL36103: 2
2026-03-30 11:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6006f5ae-f0a0-5e47-b567-5dc0d58c9d32 with identifier: ZL36103
2026-03-30 11:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6006f5ae-f0a0-5e47-b567-5dc0d58c9d32 with scrape type 2
2026-03-30 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6006f5ae-f0a0-5e47-b567-5dc0d58c9d32 with scrape type 2
2026-03-30 11:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6006f5ae-f0a0-5e47-b567-5dc0d58c9d32, identifier: ZL36103
2026-03-30 11:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6006f5ae-f0a0-5e47-b567-5dc0d58c9d32 with identifier: ZL36103
2026-03-30 11:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6006f5ae-f0a0-5e47-b567-5dc0d58c9d32 with identifier: ZL36103
2026-03-30 11:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6006f5ae-f0a0-5e47-b567-5dc0d58c9d32 with identifier: ZL36103 to the API
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:33:02Z',
 'fuel_type': 'diesel',
 'id': '6006f5ae-f0a0-5e47-b567-5dc0d58c9d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL36103',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C-Elysée',
 'odometer': 161965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-28',
 'seller_name': None,
 'title': 'Citroen C-Elysée 1.6 HDi Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2014}
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL36103%27 HTTP/1.1" 200 None
2026-03-30 11:10:39 [auto1.es] INFO: Saving data for ZL36103: {'auction_closing_time': 1774971182.0, 'created_time': 1773238490.414764, 'last_price_update_time': 1774869039.763714}
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL36103') HTTP/1.1" 204 0
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: YA12950
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: YP69224
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: YH27551
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: AH43574
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH43574%27 HTTP/1.1" 200 None
2026-03-30 11:10:39 [auto1.es] INFO: Scrape type for AH43574: 1
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: MR95745
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR95745%27 HTTP/1.1" 200 None
2026-03-30 11:10:39 [auto1.es] INFO: Scrape type for MR95745: 1
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: FR76848
2026-03-30 11:10:39 [auto1.es] INFO: Found listing with ID: LN55332
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN55332%27 HTTP/1.1" 200 None
2026-03-30 11:10:39 [auto1.es] INFO: Scrape type for LN55332: 2
2026-03-30 11:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3e6d4d8-c170-5851-9b45-893a6b458f57 with identifier: LN55332
2026-03-30 11:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3e6d4d8-c170-5851-9b45-893a6b458f57 with scrape type 2
2026-03-30 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3e6d4d8-c170-5851-9b45-893a6b458f57 with scrape type 2
2026-03-30 11:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3e6d4d8-c170-5851-9b45-893a6b458f57, identifier: LN55332
2026-03-30 11:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3e6d4d8-c170-5851-9b45-893a6b458f57 with identifier: LN55332
2026-03-30 11:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3e6d4d8-c170-5851-9b45-893a6b458f57 with identifier: LN55332
2026-03-30 11:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3e6d4d8-c170-5851-9b45-893a6b458f57 with identifier: LN55332 to the API
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:12Z',
 'fuel_type': 'petrol',
 'id': 'f3e6d4d8-c170-5851-9b45-893a6b458f57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN55332',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 82475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Xperience Go',
 'transmission': 'automatic',
 'trim': 'Xperience Go',
 'year': 2021}
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN55332%27 HTTP/1.1" 200 None
2026-03-30 11:10:40 [auto1.es] INFO: Saving data for LN55332: {'auction_closing_time': 1774969692.0, 'created_time': 1773691494.756085, 'last_price_update_time': 1774869040.271809}
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LN55332') HTTP/1.1" 204 0
2026-03-30 11:10:40 [auto1.es] INFO: Found listing with ID: BM68375
2026-03-30 11:10:40 [auto1.es] INFO: Found listing with ID: HB80191
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB80191%27 HTTP/1.1" 200 None
2026-03-30 11:10:40 [auto1.es] INFO: Scrape type for HB80191: 2
2026-03-30 11:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with identifier: HB80191
2026-03-30 11:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with scrape type 2
2026-03-30 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with scrape type 2
2026-03-30 11:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3faab5e5-8c35-5a96-aa53-83fc3dedf928, identifier: HB80191
2026-03-30 11:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with identifier: HB80191
2026-03-30 11:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with identifier: HB80191
2026-03-30 11:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with identifier: HB80191 to the API
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:27:02Z',
 'fuel_type': 'diesel',
 'id': '3faab5e5-8c35-5a96-aa53-83fc3dedf928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB80191',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 78760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB80191%27 HTTP/1.1" 200 None
2026-03-30 11:10:40 [auto1.es] INFO: Saving data for HB80191: {'auction_closing_time': 1774970822.0, 'created_time': 1773918205.303431, 'last_price_update_time': 1774869040.821123}
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HB80191') HTTP/1.1" 204 0
2026-03-30 11:10:40 [auto1.es] INFO: Found listing with ID: JX17367
2026-03-30 11:10:40 [auto1.es] INFO: Found listing with ID: WZ10661
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ10661%27 HTTP/1.1" 200 None
2026-03-30 11:10:40 [auto1.es] INFO: Scrape type for WZ10661: 2
2026-03-30 11:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0600b109-c59b-5c04-84c2-7791d52ca172 with identifier: WZ10661
2026-03-30 11:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0600b109-c59b-5c04-84c2-7791d52ca172 with scrape type 2
2026-03-30 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0600b109-c59b-5c04-84c2-7791d52ca172 with scrape type 2
2026-03-30 11:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0600b109-c59b-5c04-84c2-7791d52ca172, identifier: WZ10661
2026-03-30 11:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0600b109-c59b-5c04-84c2-7791d52ca172 with identifier: WZ10661
2026-03-30 11:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0600b109-c59b-5c04-84c2-7791d52ca172 with identifier: WZ10661
2026-03-30 11:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0600b109-c59b-5c04-84c2-7791d52ca172 with identifier: WZ10661 to the API
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:50:34Z',
 'fuel_type': 'diesel',
 'id': '0600b109-c59b-5c04-84c2-7791d52ca172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ10661',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 106871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-10',
 'seller_name': None,
 'title': 'Jaguar E-Pace D180 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2019}
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ10661%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Saving data for WZ10661: {'auction_closing_time': 1774972234.0, 'created_time': 1773132343.6623, 'last_price_update_time': 1774869041.305164}
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WZ10661') HTTP/1.1" 204 0
2026-03-30 11:10:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.529(s), this was the 1st time calling it.
2026-03-30 11:10:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.493119272463089 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: RJ36097
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: GD10545
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: FV95952
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: HZ87853
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ87853%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Scrape type for HZ87853: 1
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: HU46093
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU46093%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Scrape type for HU46093: 0
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: SP06471
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: ZJ75396
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: MF17439
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: DA93296
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA93296%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Scrape type for DA93296: 0
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: CW87826
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW87826%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Scrape type for CW87826: 0
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: KZ56767
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ56767%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Scrape type for KZ56767: 0
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: AB71147
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB71147%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Scrape type for AB71147: 0
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: GF89520
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF89520%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Scrape type for GF89520: 0
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: AV31208
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: MZ99822
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ99822%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Scrape type for MZ99822: 0
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: RL18296
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL18296%27 HTTP/1.1" 200 None
2026-03-30 11:10:41 [auto1.es] INFO: Scrape type for RL18296: 0
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: BN81239
2026-03-30 11:10:41 [auto1.es] INFO: Found listing with ID: KV37790
2026-03-30 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU86611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY46095/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ68230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT09027/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:04 [scrapy.extensions.logstats] INFO: Crawled 137 pages (at 12 pages/min), scraped 184 items (at 19 items/min)
2026-03-30 11:11:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT74362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:10 [auto1.es] INFO: Channel: 24h | Page: 12 | totalHits: 2205 | hits on page: 40
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: AP29688
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP29688%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for AP29688: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: FM74939
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM74939%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for FM74939: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: XS10937
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: MD97530
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD97530%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for MD97530: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: HR79714
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR79714%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for HR79714: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: HA53879
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA53879%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for HA53879: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: NA38669
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: ZM37153
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: RS33188
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: VK08624
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK08624%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for VK08624: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: ZE40464
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE40464%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for ZE40464: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: SF77258
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: BF57593
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF57593%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for BF57593: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: BM87438
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM87438%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for BM87438: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: CP82441
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: BP19687
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP19687%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for BP19687: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: CP16982
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16982%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for CP16982: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: XG07152
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: LL26626
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL26626%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for LL26626: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: HK75891
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK75891%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for HK75891: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: DA17068
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: SN19973
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN19973%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for SN19973: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: NN48613
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN48613%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for NN48613: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: DM10276
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: FA27272
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA27272%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for FA27272: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: MS32637
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS32637%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for MS32637: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: MR15790
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR15790%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for MR15790: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: UT51952
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: XV15787
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: JT97247
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT97247%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for JT97247: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: LB47883
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: RE29588
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: PU95944
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: VC54810
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: PM70964
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: RC14934
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC14934%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for RC14934: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: EP76379
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP76379%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for EP76379: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: DL91172
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL91172%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for DL91172: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: YH74863
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH74863%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for YH74863: 0
2026-03-30 11:11:10 [auto1.es] INFO: Found listing with ID: SW02884
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW02884%27 HTTP/1.1" 200 None
2026-03-30 11:11:10 [auto1.es] INFO: Scrape type for SW02884: 0
2026-03-30 11:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS90699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU22619/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN16192/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.258(s), this was the 1st time calling it.
2026-03-30 11:11:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.778880585259905 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:11:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.518(s), this was the 1st time calling it.
2026-03-30 11:12:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.329743891915597 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:12:04 [scrapy.extensions.logstats] INFO: Crawled 142 pages (at 5 pages/min), scraped 184 items (at 0 items/min)
2026-03-30 11:12:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW36517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU86611> (referer: https://www.auto1.com/v1/car-details-view/JU86611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76df48d3-3354-5e8c-bbf2-2a7aafb420d2 with identifier: JU86611
2026-03-30 11:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2 with scrape type 1
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_2d6f16d081d483377e1aa23f19c9cde9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_2d6f16d081d483377e1aa23f19c9cde9.jpg not downloaded yet
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_e5ec44c60276ab66c2576ed4ae51f753.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_e5ec44c60276ab66c2576ed4ae51f753.jpg not downloaded yet
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_b428f04d83c330611ba4e4efe90c2f52.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_b428f04d83c330611ba4e4efe90c2f52.jpg not downloaded yet
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_68528cb5aca1e4e329e1dfa895524754.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_68528cb5aca1e4e329e1dfa895524754.jpg not downloaded yet
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_56532d8cc31e10b31a60b5a80d5add7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_56532d8cc31e10b31a60b5a80d5add7c.jpg not downloaded yet
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_fbf7ef4f9d2c39f0853266bbaedb52a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_fbf7ef4f9d2c39f0853266bbaedb52a1.jpg not downloaded yet
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_82a5e18a124303872e3a12003b02203c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_82a5e18a124303872e3a12003b02203c.jpg not downloaded yet
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_c2e8ddb4e5102c4ded6110e920f2eb15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_c2e8ddb4e5102c4ded6110e920f2eb15.jpg not downloaded yet
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_e29f0fd019dd85fc9b915e195c440337.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_e29f0fd019dd85fc9b915e195c440337.jpg not downloaded yet
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_484d260fb14e26eff1e2bbc355a6752d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_484d260fb14e26eff1e2bbc355a6752d.jpg not downloaded yet
2026-03-30 11:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY46095> (referer: https://www.auto1.com/v1/car-details-view/SY46095/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98cb742-c253-500c-a7a6-11b7c1355adf with identifier: SY46095
2026-03-30 11:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98cb742-c253-500c-a7a6-11b7c1355adf with scrape type 1
2026-03-30 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b98cb742-c253-500c-a7a6-11b7c1355adf
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Ff4%252F92f4de2bf3ae8525df20ea2d335db53e%252Fpa%252FSY46095_d982ddf0022933b0140e5f615e77f841.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_d982ddf0022933b0140e5f615e77f841.jpg already downloaded
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Ff4%252F92f4de2bf3ae8525df20ea2d335db53e%252Fpa%252FSY46095_2dad382877a178c06fd5d043fc67970b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_2dad382877a178c06fd5d043fc67970b.jpg already downloaded
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Ff4%252F92f4de2bf3ae8525df20ea2d335db53e%252Fpa%252FSY46095_e7c5603d6c71e8faa25d66253032c0e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_e7c5603d6c71e8faa25d66253032c0e7.jpg already downloaded
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Ff4%252F92f4de2bf3ae8525df20ea2d335db53e%252Fpa%252FSY46095_c7766dccf4f15ac8dbc2a58c32b35bbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_c7766dccf4f15ac8dbc2a58c32b35bbd.jpg already downloaded
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Ff4%252F92f4de2bf3ae8525df20ea2d335db53e%252Fpa%252FSY46095_69e246df2bfa5af3a9cf2e31957edba5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_69e246df2bfa5af3a9cf2e31957edba5.jpg already downloaded
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Ff4%252F92f4de2bf3ae8525df20ea2d335db53e%252Fpa%252FSY46095_ed01a133342e5448bb130c190617c296.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_ed01a133342e5448bb130c190617c296.jpg already downloaded
2026-03-30 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b98cb742-c253-500c-a7a6-11b7c1355adf, identifier: SY46095
2026-03-30 11:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b98cb742-c253-500c-a7a6-11b7c1355adf with identifier: SY46095
2026-03-30 11:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b98cb742-c253-500c-a7a6-11b7c1355adf with identifier: SY46095
2026-03-30 11:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b98cb742-c253-500c-a7a6-11b7c1355adf with identifier: SY46095 to the API
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SY46095>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:02:02Z',
 'fuel_type': 'diesel',
 'id': 'b98cb742-c253-500c-a7a6-11b7c1355adf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY46095',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Peugeot',
 'model': '205',
 'odometer': 152136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_d982ddf0022933b0140e5f615e77f841.jpg',
                'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_2dad382877a178c06fd5d043fc67970b.jpg',
                'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_e7c5603d6c71e8faa25d66253032c0e7.jpg',
                'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_c7766dccf4f15ac8dbc2a58c32b35bbd.jpg',
                'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_69e246df2bfa5af3a9cf2e31957edba5.jpg',
                'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_ed01a133342e5448bb130c190617c296.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98cb742-c253-500c-a7a6-11b7c1355adf/b98cb742-c253-500c-a7a6-11b7c1355adf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_d982ddf0022933b0140e5f615e77f841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98cb742-c253-500c-a7a6-11b7c1355adf/b98cb742-c253-500c-a7a6-11b7c1355adf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_2dad382877a178c06fd5d043fc67970b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98cb742-c253-500c-a7a6-11b7c1355adf/b98cb742-c253-500c-a7a6-11b7c1355adf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_e7c5603d6c71e8faa25d66253032c0e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98cb742-c253-500c-a7a6-11b7c1355adf/b98cb742-c253-500c-a7a6-11b7c1355adf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_c7766dccf4f15ac8dbc2a58c32b35bbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98cb742-c253-500c-a7a6-11b7c1355adf/b98cb742-c253-500c-a7a6-11b7c1355adf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_69e246df2bfa5af3a9cf2e31957edba5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98cb742-c253-500c-a7a6-11b7c1355adf/b98cb742-c253-500c-a7a6-11b7c1355adf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/f4/92f4de2bf3ae8525df20ea2d335db53e/pa/SY46095_ed01a133342e5448bb130c190617c296.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1990-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 205 1.8 Diesel GRD',
 'transmission': 'manual',
 'trim': 'GRD',
 'year': 1990}
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY46095%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [auto1.es] INFO: Saving data for SY46095: {'created_time': 1774869139.579923, 'last_price_update_time': 1774869139.579982, 'auction_closing_time': 1774969322.0}
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SY46095') HTTP/1.1" 204 0
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_484d260fb14e26eff1e2bbc355a6752d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_e29f0fd019dd85fc9b915e195c440337.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_c2e8ddb4e5102c4ded6110e920f2eb15.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb640b290>
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_484d260fb14e26eff1e2bbc355a6752d.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_484d260fb14e26eff1e2bbc355a6752d.jpg saved to cache
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6437710>
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_e29f0fd019dd85fc9b915e195c440337.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_e29f0fd019dd85fc9b915e195c440337.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c0990>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_c2e8ddb4e5102c4ded6110e920f2eb15.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_c2e8ddb4e5102c4ded6110e920f2eb15.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_82a5e18a124303872e3a12003b02203c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65052d0>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_82a5e18a124303872e3a12003b02203c.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_82a5e18a124303872e3a12003b02203c.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_fbf7ef4f9d2c39f0853266bbaedb52a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_56532d8cc31e10b31a60b5a80d5add7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_68528cb5aca1e4e329e1dfa895524754.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6643e50>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_fbf7ef4f9d2c39f0853266bbaedb52a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_fbf7ef4f9d2c39f0853266bbaedb52a1.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6507550>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_56532d8cc31e10b31a60b5a80d5add7c.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_56532d8cc31e10b31a60b5a80d5add7c.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6436190>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_68528cb5aca1e4e329e1dfa895524754.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_68528cb5aca1e4e329e1dfa895524754.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_b428f04d83c330611ba4e4efe90c2f52.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_e5ec44c60276ab66c2576ed4ae51f753.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_2d6f16d081d483377e1aa23f19c9cde9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6688890>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_b428f04d83c330611ba4e4efe90c2f52.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_b428f04d83c330611ba4e4efe90c2f52.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65bdbd0>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_e5ec44c60276ab66c2576ed4ae51f753.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_e5ec44c60276ab66c2576ed4ae51f753.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f57ad0>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F56%252Ffb56a79c1bc300f5fbe516de1db33e11%252Fpa%252FJU86611_2d6f16d081d483377e1aa23f19c9cde9.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_2d6f16d081d483377e1aa23f19c9cde9.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2
2026-03-30 11:12:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76df48d3-3354-5e8c-bbf2-2a7aafb420d2, skipping ID generation
2026-03-30 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2 with scrape type 1
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76df48d3-3354-5e8c-bbf2-2a7aafb420d2 sending to next pipeline
2026-03-30 11:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 76df48d3-3354-5e8c-bbf2-2a7aafb420d2, identifier: JU86611
2026-03-30 11:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 76df48d3-3354-5e8c-bbf2-2a7aafb420d2 with identifier: JU86611
2026-03-30 11:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 76df48d3-3354-5e8c-bbf2-2a7aafb420d2 with identifier: JU86611
2026-03-30 11:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 76df48d3-3354-5e8c-bbf2-2a7aafb420d2 with identifier: JU86611 to the API
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_2d6f16d081d483377e1aa23f19c9cde9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '4.4L',
 'engine_horse_power': 333,
 'expiration_date': '2026-03-31T15:46:50Z',
 'fuel_type': 'petrol',
 'id': '76df48d3-3354-5e8c-bbf2-2a7aafb420d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU86611',
 'listing': 'auction',
 'location': 'ES, Pamplona',
 'make': 'BMW',
 'model': '6er',
 'odometer': 203137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_2d6f16d081d483377e1aa23f19c9cde9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_e5ec44c60276ab66c2576ed4ae51f753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_b428f04d83c330611ba4e4efe90c2f52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_68528cb5aca1e4e329e1dfa895524754.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_56532d8cc31e10b31a60b5a80d5add7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_fbf7ef4f9d2c39f0853266bbaedb52a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_82a5e18a124303872e3a12003b02203c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_c2e8ddb4e5102c4ded6110e920f2eb15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_e29f0fd019dd85fc9b915e195c440337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76df48d3-3354-5e8c-bbf2-2a7aafb420d2/76df48d3-3354-5e8c-bbf2-2a7aafb420d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a79c1bc300f5fbe516de1db33e11/pa/JU86611_484d260fb14e26eff1e2bbc355a6752d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-07-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 6er 645 CI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU86611%27 HTTP/1.1" 200 None
2026-03-30 11:12:21 [auto1.es] INFO: Saving data for JU86611: {'created_time': 1774869141.460023, 'last_price_update_time': 1774869141.460035, 'auction_closing_time': 1774972010.0}
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JU86611') HTTP/1.1" 204 0
2026-03-30 11:12:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.216(s), this was the 1st time calling it.
2026-03-30 11:12:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.3372332085027905 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU12290> (referer: https://www.auto1.com/v1/car-details-view/WU12290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9 with identifier: WU12290
2026-03-30 11:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9 with scrape type 1
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_2db19abddaa24b3c927a193073b85762.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_2db19abddaa24b3c927a193073b85762.jpg not downloaded yet
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_e4364218040773ef027ea3a390b111da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_e4364218040773ef027ea3a390b111da.jpg not downloaded yet
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_835781ed50ebbd9323c13a604ef9d1de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_835781ed50ebbd9323c13a604ef9d1de.jpg not downloaded yet
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_b0935625cb0213e933b06c9fcc221b75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_b0935625cb0213e933b06c9fcc221b75.jpg not downloaded yet
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_71f3e335e00d11194d212a3a5ceef8cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_71f3e335e00d11194d212a3a5ceef8cd.jpg not downloaded yet
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_0a5d039a4e527318ddcfd4868cb3abc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_0a5d039a4e527318ddcfd4868cb3abc3.jpg not downloaded yet
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_3952b789de89f3c8d04ce60dc15e76a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_3952b789de89f3c8d04ce60dc15e76a8.jpg not downloaded yet
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_2db19abddaa24b3c927a193073b85762.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_25309596ee5b292329a4061ad8163beb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_25309596ee5b292329a4061ad8163beb.jpg not downloaded yet
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_552745dc5978315d3a576947b070317e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_552745dc5978315d3a576947b070317e.jpg not downloaded yet
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_44cde511a08c96e0825f404ae7529949.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_44cde511a08c96e0825f404ae7529949.jpg not downloaded yet
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_3952b789de89f3c8d04ce60dc15e76a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66ebe90>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_2db19abddaa24b3c927a193073b85762.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_2db19abddaa24b3c927a193073b85762.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ68230> (referer: https://www.auto1.com/v1/car-details-view/KZ68230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc191ed0>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_3952b789de89f3c8d04ce60dc15e76a8.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_3952b789de89f3c8d04ce60dc15e76a8.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_44cde511a08c96e0825f404ae7529949.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 990ecebd-dc7c-58ae-ab26-e5c9094d13eb with identifier: KZ68230
2026-03-30 11:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 990ecebd-dc7c-58ae-ab26-e5c9094d13eb with scrape type 1
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 990ecebd-dc7c-58ae-ab26-e5c9094d13eb
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_8085a2e9b19ad159d5edb080c8613c31.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_8085a2e9b19ad159d5edb080c8613c31.jpg already downloaded
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_e94fe3077fe8322cd131f66cc6e2f384.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_e94fe3077fe8322cd131f66cc6e2f384.jpg already downloaded
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_5e714a400d612307469f7746ab730a3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_5e714a400d612307469f7746ab730a3f.jpg already downloaded
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_62a498a73d32c8fe15b602dc8700c4d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_62a498a73d32c8fe15b602dc8700c4d3.jpg already downloaded
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_ccb0e5faa4a2666b1333ad233152fbbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_ccb0e5faa4a2666b1333ad233152fbbc.jpg already downloaded
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_23d03e51735e7b69b68dcd37f0ea7b66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_23d03e51735e7b69b68dcd37f0ea7b66.jpg already downloaded
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_c4a6e3f6cdf44c9f5e46833d35a54b48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_c4a6e3f6cdf44c9f5e46833d35a54b48.jpg already downloaded
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_e78d6333e198f24cbae372662bba8760.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_e78d6333e198f24cbae372662bba8760.jpg already downloaded
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_1c37866bacd296139a012f785241c3d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_1c37866bacd296139a012f785241c3d7.jpg already downloaded
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe2%252F77e28dd79f556cae8ee9b6f70387f8f9%252Fpa%252FKZ68230_b2eac49975f7eee63559e0ae73916703.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_b2eac49975f7eee63559e0ae73916703.jpg already downloaded
2026-03-30 11:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 990ecebd-dc7c-58ae-ab26-e5c9094d13eb, identifier: KZ68230
2026-03-30 11:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 990ecebd-dc7c-58ae-ab26-e5c9094d13eb with identifier: KZ68230
2026-03-30 11:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 990ecebd-dc7c-58ae-ab26-e5c9094d13eb with identifier: KZ68230
2026-03-30 11:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 990ecebd-dc7c-58ae-ab26-e5c9094d13eb with identifier: KZ68230 to the API
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KZ68230>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-03-31T15:07:37Z',
 'fuel_type': 'petrol',
 'id': '990ecebd-dc7c-58ae-ab26-e5c9094d13eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ68230',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Fiat',
 'model': '500',
 'odometer': 125874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_8085a2e9b19ad159d5edb080c8613c31.jpg',
                'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_e94fe3077fe8322cd131f66cc6e2f384.jpg',
                'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_5e714a400d612307469f7746ab730a3f.jpg',
                'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_62a498a73d32c8fe15b602dc8700c4d3.jpg',
                'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_ccb0e5faa4a2666b1333ad233152fbbc.jpg',
                'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_23d03e51735e7b69b68dcd37f0ea7b66.jpg',
                'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_c4a6e3f6cdf44c9f5e46833d35a54b48.jpg',
                'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_e78d6333e198f24cbae372662bba8760.jpg',
                'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_1c37866bacd296139a012f785241c3d7.jpg',
                'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_b2eac49975f7eee63559e0ae73916703.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_8085a2e9b19ad159d5edb080c8613c31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_e94fe3077fe8322cd131f66cc6e2f384.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_5e714a400d612307469f7746ab730a3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_62a498a73d32c8fe15b602dc8700c4d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_ccb0e5faa4a2666b1333ad233152fbbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_23d03e51735e7b69b68dcd37f0ea7b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_c4a6e3f6cdf44c9f5e46833d35a54b48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_e78d6333e198f24cbae372662bba8760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_1c37866bacd296139a012f785241c3d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990ecebd-dc7c-58ae-ab26-e5c9094d13eb/990ecebd-dc7c-58ae-ab26-e5c9094d13eb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e2/77e28dd79f556cae8ee9b6f70387f8f9/pa/KZ68230_b2eac49975f7eee63559e0ae73916703.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2020}
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ68230%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Saving data for KZ68230: {'created_time': 1774869157.14541, 'last_price_update_time': 1774869157.145421, 'auction_closing_time': 1774969657.0}
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KZ68230') HTTP/1.1" 204 0
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_25309596ee5b292329a4061ad8163beb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_e4364218040773ef027ea3a390b111da.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT09027> (referer: https://www.auto1.com/v1/car-details-view/LT09027/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66a5710>
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_44cde511a08c96e0825f404ae7529949.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_44cde511a08c96e0825f404ae7529949.jpg saved to cache
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_552745dc5978315d3a576947b070317e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65c2590>
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_25309596ee5b292329a4061ad8163beb.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_25309596ee5b292329a4061ad8163beb.jpg saved to cache
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb654bfd0>
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_e4364218040773ef027ea3a390b111da.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_e4364218040773ef027ea3a390b111da.jpg saved to cache
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_0a5d039a4e527318ddcfd4868cb3abc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_835781ed50ebbd9323c13a604ef9d1de.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7df8e18c-0247-538d-b8f4-93056c076b00 with identifier: LT09027
2026-03-30 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7df8e18c-0247-538d-b8f4-93056c076b00 with scrape type 1
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7df8e18c-0247-538d-b8f4-93056c076b00
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_3370b03a69beee2b13ff51350c082c0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_3370b03a69beee2b13ff51350c082c0b.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_09cc9be82fe534480fccedc0172bac07.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_09cc9be82fe534480fccedc0172bac07.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_14c0c4e630d7e9cc38eaaf3114b11c4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_14c0c4e630d7e9cc38eaaf3114b11c4c.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_6a1a35da7f162101b7c42f29c31e8831.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_6a1a35da7f162101b7c42f29c31e8831.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_e796a324872d073958f8a4f5ff3f24f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_e796a324872d073958f8a4f5ff3f24f7.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_92141ec1376eb31a9333612718055313.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_92141ec1376eb31a9333612718055313.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_963f2c4f30be79d120b8962c2b3388fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_963f2c4f30be79d120b8962c2b3388fa.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_df529a18d9b57a4b3c58cc59e0008885.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_df529a18d9b57a4b3c58cc59e0008885.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_54b889acadd045c2ed21c17e1d0d8426.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_54b889acadd045c2ed21c17e1d0d8426.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0246c452ae38f922bc98fe5289814%252Fpa%252FLT09027_8bbf802d3f4033f7f4c454cf2296cfd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_8bbf802d3f4033f7f4c454cf2296cfd3.jpg already downloaded
2026-03-30 11:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7df8e18c-0247-538d-b8f4-93056c076b00, identifier: LT09027
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb643e550>
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_552745dc5978315d3a576947b070317e.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_552745dc5978315d3a576947b070317e.jpg saved to cache
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7df8e18c-0247-538d-b8f4-93056c076b00 with identifier: LT09027
2026-03-30 11:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7df8e18c-0247-538d-b8f4-93056c076b00 with identifier: LT09027
2026-03-30 11:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7df8e18c-0247-538d-b8f4-93056c076b00 with identifier: LT09027 to the API
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LT09027>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:55:55Z',
 'fuel_type': 'diesel',
 'id': '7df8e18c-0247-538d-b8f4-93056c076b00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT09027',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 157845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_3370b03a69beee2b13ff51350c082c0b.jpg',
                'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_09cc9be82fe534480fccedc0172bac07.jpg',
                'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_14c0c4e630d7e9cc38eaaf3114b11c4c.jpg',
                'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_6a1a35da7f162101b7c42f29c31e8831.jpg',
                'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_e796a324872d073958f8a4f5ff3f24f7.jpg',
                'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_92141ec1376eb31a9333612718055313.jpg',
                'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_963f2c4f30be79d120b8962c2b3388fa.jpg',
                'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_df529a18d9b57a4b3c58cc59e0008885.jpg',
                'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_54b889acadd045c2ed21c17e1d0d8426.jpg',
                'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_8bbf802d3f4033f7f4c454cf2296cfd3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_3370b03a69beee2b13ff51350c082c0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_09cc9be82fe534480fccedc0172bac07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_14c0c4e630d7e9cc38eaaf3114b11c4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_6a1a35da7f162101b7c42f29c31e8831.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_e796a324872d073958f8a4f5ff3f24f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_92141ec1376eb31a9333612718055313.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_963f2c4f30be79d120b8962c2b3388fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_df529a18d9b57a4b3c58cc59e0008885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_54b889acadd045c2ed21c17e1d0d8426.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df8e18c-0247-538d-b8f4-93056c076b00/7df8e18c-0247-538d-b8f4-93056c076b00_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0246c452ae38f922bc98fe5289814/pa/LT09027_8bbf802d3f4033f7f4c454cf2296cfd3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XE 20d Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2015}
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LT09027%27 HTTP/1.1" 200 None
2026-03-30 11:12:38 [auto1.es] INFO: Saving data for LT09027: {'created_time': 1774869158.043065, 'last_price_update_time': 1774869158.043076, 'auction_closing_time': 1774972555.0}
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LT09027') HTTP/1.1" 204 0
2026-03-30 11:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_71f3e335e00d11194d212a3a5ceef8cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.786(s), this was the 1st time calling it.
2026-03-30 11:12:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.101265348411158 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6402e10>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_0a5d039a4e527318ddcfd4868cb3abc3.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_0a5d039a4e527318ddcfd4868cb3abc3.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc276390>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_835781ed50ebbd9323c13a604ef9d1de.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_835781ed50ebbd9323c13a604ef9d1de.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65bc410>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_71f3e335e00d11194d212a3a5ceef8cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_71f3e335e00d11194d212a3a5ceef8cd.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_b0935625cb0213e933b06c9fcc221b75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f026d0>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F35%252Fef353faaa66113b48637fdb8e806457c%252Fpa%252FWU12290_b0935625cb0213e933b06c9fcc221b75.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_b0935625cb0213e933b06c9fcc221b75.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9
2026-03-30 11:12:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9, skipping ID generation
2026-03-30 11:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9 with scrape type 1
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9 sending to next pipeline
2026-03-30 11:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9, identifier: WU12290
2026-03-30 11:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9 with identifier: WU12290
2026-03-30 11:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9 with identifier: WU12290
2026-03-30 11:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9 with identifier: WU12290 to the API
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_b0935625cb0213e933b06c9fcc221b75.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:02:16Z',
 'fuel_type': 'diesel',
 'id': 'a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU12290',
 'listing': 'auction',
 'location': 'Madrid',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 293019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_2db19abddaa24b3c927a193073b85762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_e4364218040773ef027ea3a390b111da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_835781ed50ebbd9323c13a604ef9d1de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_b0935625cb0213e933b06c9fcc221b75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_71f3e335e00d11194d212a3a5ceef8cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_0a5d039a4e527318ddcfd4868cb3abc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_3952b789de89f3c8d04ce60dc15e76a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_25309596ee5b292329a4061ad8163beb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_552745dc5978315d3a576947b070317e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9/a336e6ab-57fa-5ff5-aba7-f6c534b9e8d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/35/ef353faaa66113b48637fdb8e806457c/pa/WU12290_44cde511a08c96e0825f404ae7529949.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU12290%27 HTTP/1.1" 200 None
2026-03-30 11:12:38 [auto1.es] INFO: Saving data for WU12290: {'created_time': 1774869158.935444, 'last_price_update_time': 1774869158.935454, 'auction_closing_time': 1774969336.0}
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU12290') HTTP/1.1" 204 0
2026-03-30 11:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE43737> (referer: https://www.auto1.com/v1/car-details-view/UE43737/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0077d23d-db66-56f9-b229-b2153b0dd345 with identifier: UE43737
2026-03-30 11:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0077d23d-db66-56f9-b229-b2153b0dd345 with scrape type 1
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0077d23d-db66-56f9-b229-b2153b0dd345
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_7f7bf8a8d17bc057a72b1427cf64d951.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_7f7bf8a8d17bc057a72b1427cf64d951.jpg not downloaded yet
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_d40cec6e59f9e4c9d2c6efb104b3a786.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_d40cec6e59f9e4c9d2c6efb104b3a786.jpg not downloaded yet
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_43f921729770df8a7e8b07441e77cf78.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_43f921729770df8a7e8b07441e77cf78.jpg not downloaded yet
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_edc3e1e268b6861faf8ecb3557cca175.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_edc3e1e268b6861faf8ecb3557cca175.jpg not downloaded yet
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_1123d52d678562d7b04b7e5fbc6dc72d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_1123d52d678562d7b04b7e5fbc6dc72d.jpg not downloaded yet
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_bed485a5841e39446103d379d5fae378.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_bed485a5841e39446103d379d5fae378.jpg not downloaded yet
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_7f7bf8a8d17bc057a72b1427cf64d951.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_d40cec6e59f9e4c9d2c6efb104b3a786.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_43f921729770df8a7e8b07441e77cf78.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_edc3e1e268b6861faf8ecb3557cca175.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd005450>
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_7f7bf8a8d17bc057a72b1427cf64d951.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_7f7bf8a8d17bc057a72b1427cf64d951.jpg saved to cache
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0077d23d-db66-56f9-b229-b2153b0dd345
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6452bd0>
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_d40cec6e59f9e4c9d2c6efb104b3a786.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_d40cec6e59f9e4c9d2c6efb104b3a786.jpg saved to cache
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0077d23d-db66-56f9-b229-b2153b0dd345
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_bed485a5841e39446103d379d5fae378.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc277650>
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_43f921729770df8a7e8b07441e77cf78.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_43f921729770df8a7e8b07441e77cf78.jpg saved to cache
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0077d23d-db66-56f9-b229-b2153b0dd345
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6452cd0>
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_edc3e1e268b6861faf8ecb3557cca175.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_edc3e1e268b6861faf8ecb3557cca175.jpg saved to cache
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0077d23d-db66-56f9-b229-b2153b0dd345
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_1123d52d678562d7b04b7e5fbc6dc72d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66aec50>
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_bed485a5841e39446103d379d5fae378.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_bed485a5841e39446103d379d5fae378.jpg saved to cache
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0077d23d-db66-56f9-b229-b2153b0dd345
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f00f90>
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F56%252F6956d52e833d7197bab5fbcf9ad7b47e%252Fpa%252FUE43737_1123d52d678562d7b04b7e5fbc6dc72d.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_1123d52d678562d7b04b7e5fbc6dc72d.jpg saved to cache
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0077d23d-db66-56f9-b229-b2153b0dd345
2026-03-30 11:12:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0077d23d-db66-56f9-b229-b2153b0dd345, skipping ID generation
2026-03-30 11:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0077d23d-db66-56f9-b229-b2153b0dd345 with scrape type 1
2026-03-30 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0077d23d-db66-56f9-b229-b2153b0dd345 sending to next pipeline
2026-03-30 11:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0077d23d-db66-56f9-b229-b2153b0dd345, identifier: UE43737
2026-03-30 11:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0077d23d-db66-56f9-b229-b2153b0dd345 with identifier: UE43737
2026-03-30 11:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0077d23d-db66-56f9-b229-b2153b0dd345 with identifier: UE43737
2026-03-30 11:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0077d23d-db66-56f9-b229-b2153b0dd345 with identifier: UE43737 to the API
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_1123d52d678562d7b04b7e5fbc6dc72d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:55:51Z',
 'fuel_type': 'diesel',
 'id': '0077d23d-db66-56f9-b229-b2153b0dd345',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE43737',
 'listing': 'auction',
 'location': 'ES, Zaragoza',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 303928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_7f7bf8a8d17bc057a72b1427cf64d951.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_d40cec6e59f9e4c9d2c6efb104b3a786.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_43f921729770df8a7e8b07441e77cf78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_edc3e1e268b6861faf8ecb3557cca175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_1123d52d678562d7b04b7e5fbc6dc72d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077d23d-db66-56f9-b229-b2153b0dd345/0077d23d-db66-56f9-b229-b2153b0dd345_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/56/6956d52e833d7197bab5fbcf9ad7b47e/pa/UE43737_bed485a5841e39446103d379d5fae378.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Tekna Sport',
 'transmission': 'manual',
 'trim': 'Tekna Sport',
 'year': 2011}
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE43737%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.es] INFO: Saving data for UE43737: {'created_time': 1774869178.336839, 'last_price_update_time': 1774869178.336853, 'auction_closing_time': 1774972551.0}
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UE43737') HTTP/1.1" 204 0
2026-03-30 11:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS90699> (referer: https://www.auto1.com/v1/car-details-view/BS90699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4887d5c-8649-5036-b939-61c82efc56b8 with identifier: BS90699
2026-03-30 11:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4887d5c-8649-5036-b939-61c82efc56b8 with scrape type 1
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4887d5c-8649-5036-b939-61c82efc56b8
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_9e535d395df923b2db7663cdbe957e5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_9e535d395df923b2db7663cdbe957e5d.jpg already downloaded
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_702b83bb950c103e20cfb6f02dc09de7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_702b83bb950c103e20cfb6f02dc09de7.jpg already downloaded
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_8375cb240ffc273fee29bab8719ead76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_8375cb240ffc273fee29bab8719ead76.jpg already downloaded
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_436ed45e78ff3da1a40538b3b2422c2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_436ed45e78ff3da1a40538b3b2422c2a.jpg already downloaded
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_12ad1824785c1b8f9ef5bfc5534e93d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_12ad1824785c1b8f9ef5bfc5534e93d5.jpg already downloaded
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_0e5c5b2a85b73814a2022fde28c0e619.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_0e5c5b2a85b73814a2022fde28c0e619.jpg already downloaded
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_0703d9f6c678d1174f7e3856ce83625b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_0703d9f6c678d1174f7e3856ce83625b.jpg already downloaded
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_30e2f156c8694964beba17e2503e227b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_30e2f156c8694964beba17e2503e227b.jpg already downloaded
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_82ae90b3117a394eb17c7518ce7cdc22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_82ae90b3117a394eb17c7518ce7cdc22.jpg already downloaded
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F79%252F7a79db4eee832dd1305f58f222da1bba%252Fpa%252FBS90699_374a303d95415ae9059db0d84c2abe56.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_374a303d95415ae9059db0d84c2abe56.jpg already downloaded
2026-03-30 11:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4887d5c-8649-5036-b939-61c82efc56b8, identifier: BS90699
2026-03-30 11:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4887d5c-8649-5036-b939-61c82efc56b8 with identifier: BS90699
2026-03-30 11:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4887d5c-8649-5036-b939-61c82efc56b8 with identifier: BS90699
2026-03-30 11:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4887d5c-8649-5036-b939-61c82efc56b8 with identifier: BS90699 to the API
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS90699>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:29:32Z',
 'fuel_type': 'diesel',
 'id': 'e4887d5c-8649-5036-b939-61c82efc56b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS90699',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 62153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_9e535d395df923b2db7663cdbe957e5d.jpg',
                'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_702b83bb950c103e20cfb6f02dc09de7.jpg',
                'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_8375cb240ffc273fee29bab8719ead76.jpg',
                'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_436ed45e78ff3da1a40538b3b2422c2a.jpg',
                'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_12ad1824785c1b8f9ef5bfc5534e93d5.jpg',
                'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_0e5c5b2a85b73814a2022fde28c0e619.jpg',
                'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_0703d9f6c678d1174f7e3856ce83625b.jpg',
                'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_30e2f156c8694964beba17e2503e227b.jpg',
                'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_82ae90b3117a394eb17c7518ce7cdc22.jpg',
                'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_374a303d95415ae9059db0d84c2abe56.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_9e535d395df923b2db7663cdbe957e5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_702b83bb950c103e20cfb6f02dc09de7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_8375cb240ffc273fee29bab8719ead76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_436ed45e78ff3da1a40538b3b2422c2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_12ad1824785c1b8f9ef5bfc5534e93d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_0e5c5b2a85b73814a2022fde28c0e619.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_0703d9f6c678d1174f7e3856ce83625b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_30e2f156c8694964beba17e2503e227b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_82ae90b3117a394eb17c7518ce7cdc22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4887d5c-8649-5036-b939-61c82efc56b8/e4887d5c-8649-5036-b939-61c82efc56b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/79/7a79db4eee832dd1305f58f222da1bba/pa/BS90699_374a303d95415ae9059db0d84c2abe56.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Shine XL',
 'transmission': 'automatic',
 'trim': 'Shine XL',
 'year': 2019}
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS90699%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.es] INFO: Saving data for BS90699: {'created_time': 1774869179.9811, 'last_price_update_time': 1774869179.98111, 'auction_closing_time': 1774970972.0}
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BS90699') HTTP/1.1" 204 0
2026-03-30 11:13:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.229(s), this was the 1st time calling it.
2026-03-30 11:13:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.466012066332685 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:13:04 [scrapy.extensions.logstats] INFO: Crawled 150 pages (at 8 pages/min), scraped 191 items (at 7 items/min)
2026-03-30 11:13:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT74362> (referer: https://www.auto1.com/v1/car-details-view/JT74362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f407229-d284-5b9d-bc5d-6e04dffbe68f with identifier: JT74362
2026-03-30 11:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f407229-d284-5b9d-bc5d-6e04dffbe68f with scrape type 1
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f407229-d284-5b9d-bc5d-6e04dffbe68f
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_39c87eef4e293790a87c9c9d43f568a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_39c87eef4e293790a87c9c9d43f568a9.jpg already downloaded
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_9690e9cbb80c8564f93688d7e00ce784.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_9690e9cbb80c8564f93688d7e00ce784.jpg already downloaded
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_946e0aeb6a2c3b2aa0b8a18f965fa42c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_946e0aeb6a2c3b2aa0b8a18f965fa42c.jpg already downloaded
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_b670257635a2964b81e72fec2e98eafe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_b670257635a2964b81e72fec2e98eafe.jpg already downloaded
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_2b9ab2423dc1a2ee0494bdf312cc39cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_2b9ab2423dc1a2ee0494bdf312cc39cc.jpg already downloaded
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_a928d26cba9db35f9a2a995ad131f0ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_a928d26cba9db35f9a2a995ad131f0ed.jpg already downloaded
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_8f801f827ada91125307c93e2c702031.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_8f801f827ada91125307c93e2c702031.jpg already downloaded
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_d0358289482c54dee014ba811ae778e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_d0358289482c54dee014ba811ae778e5.jpg already downloaded
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_9a7f7488692179c84ccd7a08513f0f92.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_9a7f7488692179c84ccd7a08513f0f92.jpg already downloaded
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F29%252Fd9294bbb3a0e2cc626dd9e739dadabee%252Fpa%252FJT74362_7707fa8ddd6f548e9b6340b0ace5bc00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_7707fa8ddd6f548e9b6340b0ace5bc00.jpg already downloaded
2026-03-30 11:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f407229-d284-5b9d-bc5d-6e04dffbe68f, identifier: JT74362
2026-03-30 11:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f407229-d284-5b9d-bc5d-6e04dffbe68f with identifier: JT74362
2026-03-30 11:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f407229-d284-5b9d-bc5d-6e04dffbe68f with identifier: JT74362
2026-03-30 11:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f407229-d284-5b9d-bc5d-6e04dffbe68f with identifier: JT74362 to the API
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT74362>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:30:18Z',
 'fuel_type': 'diesel',
 'id': '6f407229-d284-5b9d-bc5d-6e04dffbe68f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT74362',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 234164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_39c87eef4e293790a87c9c9d43f568a9.jpg',
                'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_9690e9cbb80c8564f93688d7e00ce784.jpg',
                'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_946e0aeb6a2c3b2aa0b8a18f965fa42c.jpg',
                'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_b670257635a2964b81e72fec2e98eafe.jpg',
                'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_2b9ab2423dc1a2ee0494bdf312cc39cc.jpg',
                'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_a928d26cba9db35f9a2a995ad131f0ed.jpg',
                'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_8f801f827ada91125307c93e2c702031.jpg',
                'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_d0358289482c54dee014ba811ae778e5.jpg',
                'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_9a7f7488692179c84ccd7a08513f0f92.jpg',
                'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_7707fa8ddd6f548e9b6340b0ace5bc00.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_39c87eef4e293790a87c9c9d43f568a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_9690e9cbb80c8564f93688d7e00ce784.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_946e0aeb6a2c3b2aa0b8a18f965fa42c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_b670257635a2964b81e72fec2e98eafe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_2b9ab2423dc1a2ee0494bdf312cc39cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_a928d26cba9db35f9a2a995ad131f0ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_8f801f827ada91125307c93e2c702031.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_d0358289482c54dee014ba811ae778e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_9a7f7488692179c84ccd7a08513f0f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f407229-d284-5b9d-bc5d-6e04dffbe68f/6f407229-d284-5b9d-bc5d-6e04dffbe68f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/29/d9294bbb3a0e2cc626dd9e739dadabee/pa/JT74362_7707fa8ddd6f548e9b6340b0ace5bc00.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2023}
2026-03-30 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT74362%27 HTTP/1.1" 200 None
2026-03-30 11:13:08 [auto1.es] INFO: Saving data for JT74362: {'created_time': 1774869188.093053, 'last_price_update_time': 1774869188.093065, 'auction_closing_time': 1774971018.0}
2026-03-30 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JT74362') HTTP/1.1" 204 0
2026-03-30 11:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN16192> (referer: https://www.auto1.com/v1/car-details-view/RN16192/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c73f33b-3918-56f0-9bb2-305c409af4a8 with identifier: RN16192
2026-03-30 11:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c73f33b-3918-56f0-9bb2-305c409af4a8 with scrape type 1
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c73f33b-3918-56f0-9bb2-305c409af4a8
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_51ab0de44bfe3de5e859552012ef0427.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_51ab0de44bfe3de5e859552012ef0427.jpg already downloaded
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_c796af161bcf909b728c356b3fbd0bf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_c796af161bcf909b728c356b3fbd0bf2.jpg already downloaded
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_5be501b43e8bc0507053983a9bc5e897.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_5be501b43e8bc0507053983a9bc5e897.jpg already downloaded
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_26bc2b78d77dd7d2828de57c2f8420a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_26bc2b78d77dd7d2828de57c2f8420a9.jpg already downloaded
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_443c3c3c58ec782e98fbc125d45aaf83.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_443c3c3c58ec782e98fbc125d45aaf83.jpg already downloaded
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_d3632cd74d8d399ddbbe53966d425b7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_d3632cd74d8d399ddbbe53966d425b7b.jpg already downloaded
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_48ac267192ddac078fb442847e577d6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_48ac267192ddac078fb442847e577d6b.jpg already downloaded
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_b5df74aac16e7d72d42b27ddc24f96b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_b5df74aac16e7d72d42b27ddc24f96b7.jpg already downloaded
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_1735f2ec602349e0c38db260d8b26c08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_1735f2ec602349e0c38db260d8b26c08.jpg already downloaded
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fea%252F07ea819ac4087bc7b1cfd3af6b7eae1c%252Fpa%252FRN16192_3cfb978ce700f97229227a67252b61c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_3cfb978ce700f97229227a67252b61c4.jpg already downloaded
2026-03-30 11:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c73f33b-3918-56f0-9bb2-305c409af4a8, identifier: RN16192
2026-03-30 11:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c73f33b-3918-56f0-9bb2-305c409af4a8 with identifier: RN16192
2026-03-30 11:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c73f33b-3918-56f0-9bb2-305c409af4a8 with identifier: RN16192
2026-03-30 11:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c73f33b-3918-56f0-9bb2-305c409af4a8 with identifier: RN16192 to the API
2026-03-30 11:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN16192>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:55:47Z',
 'fuel_type': 'petrol',
 'id': '4c73f33b-3918-56f0-9bb2-305c409af4a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN16192',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 158074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_51ab0de44bfe3de5e859552012ef0427.jpg',
                'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_c796af161bcf909b728c356b3fbd0bf2.jpg',
                'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_5be501b43e8bc0507053983a9bc5e897.jpg',
                'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_26bc2b78d77dd7d2828de57c2f8420a9.jpg',
                'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_443c3c3c58ec782e98fbc125d45aaf83.jpg',
                'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_d3632cd74d8d399ddbbe53966d425b7b.jpg',
                'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_48ac267192ddac078fb442847e577d6b.jpg',
                'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_b5df74aac16e7d72d42b27ddc24f96b7.jpg',
                'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_1735f2ec602349e0c38db260d8b26c08.jpg',
                'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_3cfb978ce700f97229227a67252b61c4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_51ab0de44bfe3de5e859552012ef0427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_c796af161bcf909b728c356b3fbd0bf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_5be501b43e8bc0507053983a9bc5e897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_26bc2b78d77dd7d2828de57c2f8420a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_443c3c3c58ec782e98fbc125d45aaf83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_d3632cd74d8d399ddbbe53966d425b7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_48ac267192ddac078fb442847e577d6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_b5df74aac16e7d72d42b27ddc24f96b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_1735f2ec602349e0c38db260d8b26c08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c73f33b-3918-56f0-9bb2-305c409af4a8/4c73f33b-3918-56f0-9bb2-305c409af4a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/ea/07ea819ac4087bc7b1cfd3af6b7eae1c/pa/RN16192_3cfb978ce700f97229227a67252b61c4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 e-THP Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2016}
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN16192%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [auto1.es] INFO: Saving data for RN16192: {'created_time': 1774869191.155451, 'last_price_update_time': 1774869191.155462, 'auction_closing_time': 1774972547.0}
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RN16192') HTTP/1.1" 204 0
2026-03-30 11:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW36517> (referer: https://www.auto1.com/v1/car-details-view/BW36517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cea4bb85-2142-5de6-b027-21e42aec1131 with identifier: BW36517
2026-03-30 11:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cea4bb85-2142-5de6-b027-21e42aec1131 with scrape type 1
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cea4bb85-2142-5de6-b027-21e42aec1131
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_36f111432dac9eb856ebee27a8645fe6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_36f111432dac9eb856ebee27a8645fe6.jpg already downloaded
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_86a9fdfb9f7e3e224b253a8bcb9e0269.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_86a9fdfb9f7e3e224b253a8bcb9e0269.jpg already downloaded
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_9e3021e92441f43d009241c1538365b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_9e3021e92441f43d009241c1538365b3.jpg already downloaded
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_20fadfdaa956494f2ea3af442e95bdf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_20fadfdaa956494f2ea3af442e95bdf8.jpg already downloaded
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_c8c5fb4d2750e5164aa8907d16fc3e08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_c8c5fb4d2750e5164aa8907d16fc3e08.jpg already downloaded
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_3668c04fbd55c016d7be0854a67579a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_3668c04fbd55c016d7be0854a67579a7.jpg already downloaded
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_d74e3a66ceb13af03742f3a43ec09ed9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_d74e3a66ceb13af03742f3a43ec09ed9.jpg already downloaded
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_90188ba71f39d09c53d9bf22e7ab2ffa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_90188ba71f39d09c53d9bf22e7ab2ffa.jpg already downloaded
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_a95d8f59157bc94cd7028441d59e0c2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_a95d8f59157bc94cd7028441d59e0c2b.jpg already downloaded
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F8a%252F498a8eb49be8105368388e13c6c90477%252Fpa%252FBW36517_54e1d8f134dac220526a1bfab61194af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_54e1d8f134dac220526a1bfab61194af.jpg already downloaded
2026-03-30 11:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cea4bb85-2142-5de6-b027-21e42aec1131, identifier: BW36517
2026-03-30 11:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cea4bb85-2142-5de6-b027-21e42aec1131 with identifier: BW36517
2026-03-30 11:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cea4bb85-2142-5de6-b027-21e42aec1131 with identifier: BW36517
2026-03-30 11:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cea4bb85-2142-5de6-b027-21e42aec1131 with identifier: BW36517 to the API
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW36517>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:13:13Z',
 'fuel_type': 'diesel',
 'id': 'cea4bb85-2142-5de6-b027-21e42aec1131',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW36517',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 144788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_36f111432dac9eb856ebee27a8645fe6.jpg',
                'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_86a9fdfb9f7e3e224b253a8bcb9e0269.jpg',
                'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_9e3021e92441f43d009241c1538365b3.jpg',
                'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_20fadfdaa956494f2ea3af442e95bdf8.jpg',
                'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_c8c5fb4d2750e5164aa8907d16fc3e08.jpg',
                'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_3668c04fbd55c016d7be0854a67579a7.jpg',
                'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_d74e3a66ceb13af03742f3a43ec09ed9.jpg',
                'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_90188ba71f39d09c53d9bf22e7ab2ffa.jpg',
                'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_a95d8f59157bc94cd7028441d59e0c2b.jpg',
                'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_54e1d8f134dac220526a1bfab61194af.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_36f111432dac9eb856ebee27a8645fe6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_86a9fdfb9f7e3e224b253a8bcb9e0269.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_9e3021e92441f43d009241c1538365b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_20fadfdaa956494f2ea3af442e95bdf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_c8c5fb4d2750e5164aa8907d16fc3e08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_3668c04fbd55c016d7be0854a67579a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_d74e3a66ceb13af03742f3a43ec09ed9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_90188ba71f39d09c53d9bf22e7ab2ffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_a95d8f59157bc94cd7028441d59e0c2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea4bb85-2142-5de6-b027-21e42aec1131/cea4bb85-2142-5de6-b027-21e42aec1131_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/8a/498a8eb49be8105368388e13c6c90477/pa/BW36517_54e1d8f134dac220526a1bfab61194af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2022}
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW36517%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [auto1.es] INFO: Saving data for BW36517: {'created_time': 1774869192.820978, 'last_price_update_time': 1774869192.820991, 'auction_closing_time': 1774969993.0}
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BW36517') HTTP/1.1" 204 0
2026-03-30 11:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY88672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY88672> (referer: https://www.auto1.com/v1/car-details-view/YY88672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91fa713d-c99e-56ea-acde-52ecd7c71731 with identifier: YY88672
2026-03-30 11:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91fa713d-c99e-56ea-acde-52ecd7c71731 with scrape type 1
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91fa713d-c99e-56ea-acde-52ecd7c71731
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_bb9b5bde342bdb8b059e661b96af6a13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_bb9b5bde342bdb8b059e661b96af6a13.jpg already downloaded
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_6f31dbd5fbe27ad5b971ae01d049fcd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_6f31dbd5fbe27ad5b971ae01d049fcd6.jpg already downloaded
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_0790b3239ec7f80fe83d334ed3a02c84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_0790b3239ec7f80fe83d334ed3a02c84.jpg already downloaded
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_e5b4baf9aff8296f10ead8de3fde8807.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_e5b4baf9aff8296f10ead8de3fde8807.jpg already downloaded
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_dddb2b5fb16810cb6ae91c4db98075af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_dddb2b5fb16810cb6ae91c4db98075af.jpg already downloaded
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_ecff101304921cafa9ae8a8fa4336630.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_ecff101304921cafa9ae8a8fa4336630.jpg already downloaded
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_4b5b8debb07cba407b80f91e1cb4f90c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_4b5b8debb07cba407b80f91e1cb4f90c.jpg already downloaded
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_1a2357313bd617e8c4c3a4ce5c9adf52.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_1a2357313bd617e8c4c3a4ce5c9adf52.jpg already downloaded
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_785b7c9e7140699018fac44b0e7162c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_785b7c9e7140699018fac44b0e7162c8.jpg already downloaded
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F10%252F2110bcdd2742bd6d60ce17119d1d4de8%252Fpa%252FYY88672_9fdf9dbb7f7a59c8ac966952b1d80531.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_9fdf9dbb7f7a59c8ac966952b1d80531.jpg already downloaded
2026-03-30 11:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91fa713d-c99e-56ea-acde-52ecd7c71731, identifier: YY88672
2026-03-30 11:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91fa713d-c99e-56ea-acde-52ecd7c71731 with identifier: YY88672
2026-03-30 11:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91fa713d-c99e-56ea-acde-52ecd7c71731 with identifier: YY88672
2026-03-30 11:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91fa713d-c99e-56ea-acde-52ecd7c71731 with identifier: YY88672 to the API
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YY88672>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '3.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:34:35Z',
 'fuel_type': 'petrol',
 'id': '91fa713d-c99e-56ea-acde-52ecd7c71731',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY88672',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Lexus',
 'model': 'GS-Serie',
 'odometer': 205601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_bb9b5bde342bdb8b059e661b96af6a13.jpg',
                'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_6f31dbd5fbe27ad5b971ae01d049fcd6.jpg',
                'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_0790b3239ec7f80fe83d334ed3a02c84.jpg',
                'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_e5b4baf9aff8296f10ead8de3fde8807.jpg',
                'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_dddb2b5fb16810cb6ae91c4db98075af.jpg',
                'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_ecff101304921cafa9ae8a8fa4336630.jpg',
                'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_4b5b8debb07cba407b80f91e1cb4f90c.jpg',
                'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_1a2357313bd617e8c4c3a4ce5c9adf52.jpg',
                'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_785b7c9e7140699018fac44b0e7162c8.jpg',
                'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_9fdf9dbb7f7a59c8ac966952b1d80531.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_bb9b5bde342bdb8b059e661b96af6a13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_6f31dbd5fbe27ad5b971ae01d049fcd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_0790b3239ec7f80fe83d334ed3a02c84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_e5b4baf9aff8296f10ead8de3fde8807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_dddb2b5fb16810cb6ae91c4db98075af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_ecff101304921cafa9ae8a8fa4336630.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_4b5b8debb07cba407b80f91e1cb4f90c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_1a2357313bd617e8c4c3a4ce5c9adf52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_785b7c9e7140699018fac44b0e7162c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fa713d-c99e-56ea-acde-52ecd7c71731/91fa713d-c99e-56ea-acde-52ecd7c71731_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/10/2110bcdd2742bd6d60ce17119d1d4de8/pa/YY88672_9fdf9dbb7f7a59c8ac966952b1d80531.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-07-11',
 'seats_number': 1,
 'seller_name': None,
 'title': 'Lexus GS-Serie GS 300',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY88672%27 HTTP/1.1" 200 None
2026-03-30 11:13:18 [auto1.es] INFO: Saving data for YY88672: {'created_time': 1774869198.807408, 'last_price_update_time': 1774869198.80742, 'auction_closing_time': 1774971275.0}
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YY88672') HTTP/1.1" 204 0
2026-03-30 11:13:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.205(s), this was the 1st time calling it.
2026-03-30 11:13:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.569787140007231 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:13:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.814(s), this was the 1st time calling it.
2026-03-30 11:13:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.575651364526209 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:13:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:13:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.073(s), this was the 1st time calling it.
2026-03-30 11:13:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.170604143024401 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH43574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH43574> (referer: https://www.auto1.com/v1/car-details-view/AH43574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16df5cfe-be12-52cd-b254-52d55554640a with identifier: AH43574
2026-03-30 11:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16df5cfe-be12-52cd-b254-52d55554640a with scrape type 1
2026-03-30 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 16df5cfe-be12-52cd-b254-52d55554640a
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F41%252F934156a61a786652d2705e30ef15c398%252Fpa%252FAH43574_ee4f456ac2a1abe8c631db3c1a8ec7ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_ee4f456ac2a1abe8c631db3c1a8ec7ea.jpg already downloaded
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F41%252F934156a61a786652d2705e30ef15c398%252Fpa%252FAH43574_b8313cbba3f1d9ff8006283e2ac60100.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_b8313cbba3f1d9ff8006283e2ac60100.jpg already downloaded
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F41%252F934156a61a786652d2705e30ef15c398%252Fpa%252FAH43574_e3443067f9854ad56a9b9ed96525ac98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_e3443067f9854ad56a9b9ed96525ac98.jpg already downloaded
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F41%252F934156a61a786652d2705e30ef15c398%252Fpa%252FAH43574_c2cabf41e3942a56e642203343fbad01.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_c2cabf41e3942a56e642203343fbad01.jpg already downloaded
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F41%252F934156a61a786652d2705e30ef15c398%252Fpa%252FAH43574_a2b480dc5dc9df32651e60c149705d92.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_a2b480dc5dc9df32651e60c149705d92.jpg already downloaded
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F41%252F934156a61a786652d2705e30ef15c398%252Fpa%252FAH43574_e829afed39433dd4abbdb42e33b30252.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_e829afed39433dd4abbdb42e33b30252.jpg already downloaded
2026-03-30 11:13:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 16df5cfe-be12-52cd-b254-52d55554640a, identifier: AH43574
2026-03-30 11:13:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 16df5cfe-be12-52cd-b254-52d55554640a with identifier: AH43574
2026-03-30 11:13:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 16df5cfe-be12-52cd-b254-52d55554640a with identifier: AH43574
2026-03-30 11:13:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 16df5cfe-be12-52cd-b254-52d55554640a with identifier: AH43574 to the API
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AH43574>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:52:26Z',
 'fuel_type': 'petrol',
 'id': '16df5cfe-be12-52cd-b254-52d55554640a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH43574',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 89946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_ee4f456ac2a1abe8c631db3c1a8ec7ea.jpg',
                'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_b8313cbba3f1d9ff8006283e2ac60100.jpg',
                'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_e3443067f9854ad56a9b9ed96525ac98.jpg',
                'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_c2cabf41e3942a56e642203343fbad01.jpg',
                'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_a2b480dc5dc9df32651e60c149705d92.jpg',
                'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_e829afed39433dd4abbdb42e33b30252.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16df5cfe-be12-52cd-b254-52d55554640a/16df5cfe-be12-52cd-b254-52d55554640a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_ee4f456ac2a1abe8c631db3c1a8ec7ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16df5cfe-be12-52cd-b254-52d55554640a/16df5cfe-be12-52cd-b254-52d55554640a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_b8313cbba3f1d9ff8006283e2ac60100.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16df5cfe-be12-52cd-b254-52d55554640a/16df5cfe-be12-52cd-b254-52d55554640a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_e3443067f9854ad56a9b9ed96525ac98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16df5cfe-be12-52cd-b254-52d55554640a/16df5cfe-be12-52cd-b254-52d55554640a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_c2cabf41e3942a56e642203343fbad01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16df5cfe-be12-52cd-b254-52d55554640a/16df5cfe-be12-52cd-b254-52d55554640a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_a2b480dc5dc9df32651e60c149705d92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16df5cfe-be12-52cd-b254-52d55554640a/16df5cfe-be12-52cd-b254-52d55554640a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/41/934156a61a786652d2705e30ef15c398/pa/AH43574_e829afed39433dd4abbdb42e33b30252.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 SX Plus',
 'transmission': 'manual',
 'trim': 'SX Plus',
 'year': 2002}
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH43574%27 HTTP/1.1" 200 None
2026-03-30 11:13:31 [auto1.es] INFO: Saving data for AH43574: {'created_time': 1774869211.900744, 'last_price_update_time': 1774869211.900754, 'auction_closing_time': 1774972346.0}
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AH43574') HTTP/1.1" 204 0
2026-03-30 11:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU22619> (referer: https://www.auto1.com/v1/car-details-view/GU22619/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee75f595-ad0e-5af2-8d36-9430bad4f4cf with identifier: GU22619
2026-03-30 11:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf with scrape type 1
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_34136d30c9fa70ed875cd65b82e8a07a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_34136d30c9fa70ed875cd65b82e8a07a.jpg not downloaded yet
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_01509bb936d18c8c19835f26961e788e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_01509bb936d18c8c19835f26961e788e.jpg not downloaded yet
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_a478574cb42e1718c7e4173a9e4c36d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_a478574cb42e1718c7e4173a9e4c36d7.jpg not downloaded yet
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_9ad8cf0e92f2fa25fa3c82b031c3ce93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_9ad8cf0e92f2fa25fa3c82b031c3ce93.jpg not downloaded yet
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_fdab04b79e7c97f93e14b6cedc48644f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_fdab04b79e7c97f93e14b6cedc48644f.jpg not downloaded yet
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_a2e1aac22b43b1c8070fe2184a7cb480.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_a2e1aac22b43b1c8070fe2184a7cb480.jpg not downloaded yet
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_8d1155927f1bf7d9aacc756006c49b81.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_8d1155927f1bf7d9aacc756006c49b81.jpg not downloaded yet
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_34136d30c9fa70ed875cd65b82e8a07a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_01509bb936d18c8c19835f26961e788e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_211dd1dd95d923a37e9ff6884befd6a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_211dd1dd95d923a37e9ff6884befd6a6.jpg not downloaded yet
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_7f6dfa258e2f7b7fefcf6919491a2d92.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_7f6dfa258e2f7b7fefcf6919491a2d92.jpg not downloaded yet
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_a478574cb42e1718c7e4173a9e4c36d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_30462a8bb0f987acc02206965ec9e443.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_30462a8bb0f987acc02206965ec9e443.jpg not downloaded yet
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_9ad8cf0e92f2fa25fa3c82b031c3ce93.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_211dd1dd95d923a37e9ff6884befd6a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6505a90>
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_34136d30c9fa70ed875cd65b82e8a07a.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_34136d30c9fa70ed875cd65b82e8a07a.jpg saved to cache
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f56650>
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_01509bb936d18c8c19835f26961e788e.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_01509bb936d18c8c19835f26961e788e.jpg saved to cache
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_7f6dfa258e2f7b7fefcf6919491a2d92.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_30462a8bb0f987acc02206965ec9e443.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_fdab04b79e7c97f93e14b6cedc48644f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6662990>
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_a478574cb42e1718c7e4173a9e4c36d7.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_a478574cb42e1718c7e4173a9e4c36d7.jpg saved to cache
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc219750>
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_9ad8cf0e92f2fa25fa3c82b031c3ce93.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_9ad8cf0e92f2fa25fa3c82b031c3ce93.jpg saved to cache
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6499710>
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_211dd1dd95d923a37e9ff6884befd6a6.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_211dd1dd95d923a37e9ff6884befd6a6.jpg saved to cache
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_8d1155927f1bf7d9aacc756006c49b81.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6601b50>
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_7f6dfa258e2f7b7fefcf6919491a2d92.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_7f6dfa258e2f7b7fefcf6919491a2d92.jpg saved to cache
2026-03-30 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb649a710>
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_30462a8bb0f987acc02206965ec9e443.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_30462a8bb0f987acc02206965ec9e443.jpg saved to cache
2026-03-30 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb650d3d0>
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_fdab04b79e7c97f93e14b6cedc48644f.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_fdab04b79e7c97f93e14b6cedc48644f.jpg saved to cache
2026-03-30 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6587610>
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_8d1155927f1bf7d9aacc756006c49b81.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_8d1155927f1bf7d9aacc756006c49b81.jpg saved to cache
2026-03-30 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_a2e1aac22b43b1c8070fe2184a7cb480.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ87853/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fb1c10>
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe9%252F3ce9a17515e93c291602b603283f5e40%252Fpa%252FGU22619_a2e1aac22b43b1c8070fe2184a7cb480.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_a2e1aac22b43b1c8070fe2184a7cb480.jpg saved to cache
2026-03-30 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf
2026-03-30 11:13:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee75f595-ad0e-5af2-8d36-9430bad4f4cf, skipping ID generation
2026-03-30 11:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf with scrape type 1
2026-03-30 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee75f595-ad0e-5af2-8d36-9430bad4f4cf sending to next pipeline
2026-03-30 11:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee75f595-ad0e-5af2-8d36-9430bad4f4cf, identifier: GU22619
2026-03-30 11:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee75f595-ad0e-5af2-8d36-9430bad4f4cf with identifier: GU22619
2026-03-30 11:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee75f595-ad0e-5af2-8d36-9430bad4f4cf with identifier: GU22619
2026-03-30 11:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee75f595-ad0e-5af2-8d36-9430bad4f4cf with identifier: GU22619 to the API
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_a2e1aac22b43b1c8070fe2184a7cb480.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:59:03Z',
 'fuel_type': 'petrol',
 'id': 'ee75f595-ad0e-5af2-8d36-9430bad4f4cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU22619',
 'listing': 'auction',
 'location': 'ES, Torrevieja',
 'make': 'Fiat',
 'model': '500',
 'odometer': 142378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_34136d30c9fa70ed875cd65b82e8a07a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_01509bb936d18c8c19835f26961e788e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_a478574cb42e1718c7e4173a9e4c36d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_9ad8cf0e92f2fa25fa3c82b031c3ce93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_fdab04b79e7c97f93e14b6cedc48644f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_a2e1aac22b43b1c8070fe2184a7cb480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_8d1155927f1bf7d9aacc756006c49b81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_211dd1dd95d923a37e9ff6884befd6a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_7f6dfa258e2f7b7fefcf6919491a2d92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee75f595-ad0e-5af2-8d36-9430bad4f4cf/ee75f595-ad0e-5af2-8d36-9430bad4f4cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e9/3ce9a17515e93c291602b603283f5e40/pa/GU22619_30462a8bb0f987acc02206965ec9e443.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU22619%27 HTTP/1.1" 200 None
2026-03-30 11:13:42 [auto1.es] INFO: Saving data for GU22619: {'created_time': 1774869222.728131, 'last_price_update_time': 1774869222.728142, 'auction_closing_time': 1774972743.0}
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GU22619') HTTP/1.1" 204 0
2026-03-30 11:13:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:43 [auto1.es] INFO: Channel: 24h | Page: 13 | totalHits: 2207 | hits on page: 40
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: YH74863
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH74863%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for YH74863: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: SW02884
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW02884%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for SW02884: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: EV89270
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV89270%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for EV89270: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: TM60854
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM60854%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for TM60854: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: RS73770
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: CP22124
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: FP58894
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: JV83587
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: VJ60171
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: AF99504
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF99504%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for AF99504: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: SM68144
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM68144%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for SM68144: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: XX78085
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX78085%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for XX78085: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: AP25949
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: WV86168
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV86168%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for WV86168: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: BF01756
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: MY64125
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: KP50640
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP50640%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for KP50640: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: WR94987
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR94987%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for WR94987: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: AV80298
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV80298%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for AV80298: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: HW71789
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW71789%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for HW71789: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: SC66247
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: FG51952
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: AY69334
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY69334%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for AY69334: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: VX31855
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: HW63971
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: CB77885
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: DT19492
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: FB21971
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: SW49334
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: EZ15319
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ15319%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for EZ15319: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: JF96117
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF96117%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for JF96117: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: LH19294
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: TR96554
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: TB43728
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: GY72881
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY72881%27 HTTP/1.1" 200 None
2026-03-30 11:13:43 [auto1.es] INFO: Scrape type for GY72881: 0
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: WZ04978
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: JP85888
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: VS82741
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: DZ12321
2026-03-30 11:13:43 [auto1.es] INFO: Found listing with ID: GT09019
2026-03-30 11:13:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:44 [auto1.es] INFO: Channel: 24h | Page: 14 | totalHits: 2207 | hits on page: 40
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: JH64240
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH64240%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for JH64240: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: XP46795
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP46795%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for XP46795: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: RL76875
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: DL26730
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: EZ05250
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ05250%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for EZ05250: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: KV39877
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: LZ54087
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: KJ86287
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: RR39906
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: PA95147
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: LJ17075
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: KY65056
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: AX32587
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX32587%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for AX32587: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: XB50501
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: PP33108
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP33108%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for PP33108: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: KK89963
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK89963%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for KK89963: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: KA39853
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA39853%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for KA39853: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: GJ09914
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ09914%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for GJ09914: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: XU70286
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: JK50290
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK50290%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for JK50290: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: PU11377
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU11377%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for PU11377: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: BL04336
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: AK94783
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK94783%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for AK94783: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: JE94628
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE94628%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for JE94628: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: AA87480
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA87480%27 HTTP/1.1" 200 None
2026-03-30 11:13:44 [auto1.es] INFO: Scrape type for AA87480: 0
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: WX28872
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: XY28790
2026-03-30 11:13:44 [auto1.es] INFO: Found listing with ID: AM26013
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM26013%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [auto1.es] INFO: Scrape type for AM26013: 0
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: KZ85451
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: GS56941
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: PY75360
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY75360%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [auto1.es] INFO: Scrape type for PY75360: 0
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: JG42425
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG42425%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [auto1.es] INFO: Scrape type for JG42425: 0
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: GG87670
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: GV33472
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: PZ69063
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ69063%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [auto1.es] INFO: Scrape type for PZ69063: 0
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: JR66808
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: ZZ58056
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ58056%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [auto1.es] INFO: Scrape type for ZZ58056: 0
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: GB45080
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: DB65151
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB65151%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [auto1.es] INFO: Scrape type for DB65151: 0
2026-03-30 11:13:45 [auto1.es] INFO: Found listing with ID: TV66398
2026-03-30 11:13:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ87853> (referer: https://www.auto1.com/v1/car-details-view/HZ87853/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with identifier: HZ87853
2026-03-30 11:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with scrape type 1
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_0be7b65139202e549081150805d42900.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_0be7b65139202e549081150805d42900.jpg not downloaded yet
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_00b2bd247e4afeff7c3156f7a53b72fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_00b2bd247e4afeff7c3156f7a53b72fa.jpg not downloaded yet
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_574e8c58096036119906e99494b416bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_574e8c58096036119906e99494b416bb.jpg not downloaded yet
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_e9805a52fab04175ef295d6c1f5f2bfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_e9805a52fab04175ef295d6c1f5f2bfc.jpg not downloaded yet
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_46f37495291f527ba140e67a4bc21ad9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_46f37495291f527ba140e67a4bc21ad9.jpg not downloaded yet
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_a48f7d1c55f30cbc1070c02b2cd4095b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_a48f7d1c55f30cbc1070c02b2cd4095b.jpg not downloaded yet
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_bbf5943c32eec3699523bdd0a6929346.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_bbf5943c32eec3699523bdd0a6929346.jpg not downloaded yet
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_acd688798c3f4025615eecd3370c92e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_acd688798c3f4025615eecd3370c92e8.jpg not downloaded yet
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_0be7b65139202e549081150805d42900.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_f0f40f71f525fdb7500397939803a9b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_f0f40f71f525fdb7500397939803a9b3.jpg not downloaded yet
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_00b2bd247e4afeff7c3156f7a53b72fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_a4bc168f23832845f975e678a618cd19.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_a4bc168f23832845f975e678a618cd19.jpg not downloaded yet
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_574e8c58096036119906e99494b416bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_a48f7d1c55f30cbc1070c02b2cd4095b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_46f37495291f527ba140e67a4bc21ad9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_a4bc168f23832845f975e678a618cd19.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_acd688798c3f4025615eecd3370c92e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6660ed0>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_0be7b65139202e549081150805d42900.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_0be7b65139202e549081150805d42900.jpg saved to cache
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_f0f40f71f525fdb7500397939803a9b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_e9805a52fab04175ef295d6c1f5f2bfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd2d5e50>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_00b2bd247e4afeff7c3156f7a53b72fa.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_00b2bd247e4afeff7c3156f7a53b72fa.jpg saved to cache
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6567690>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_574e8c58096036119906e99494b416bb.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_574e8c58096036119906e99494b416bb.jpg saved to cache
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f4e050>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_a48f7d1c55f30cbc1070c02b2cd4095b.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_a48f7d1c55f30cbc1070c02b2cd4095b.jpg saved to cache
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6513050>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_46f37495291f527ba140e67a4bc21ad9.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_46f37495291f527ba140e67a4bc21ad9.jpg saved to cache
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f15e90>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_a4bc168f23832845f975e678a618cd19.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_a4bc168f23832845f975e678a618cd19.jpg saved to cache
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66e5610>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_acd688798c3f4025615eecd3370c92e8.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_acd688798c3f4025615eecd3370c92e8.jpg saved to cache
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6fcb250>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_f0f40f71f525fdb7500397939803a9b3.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_f0f40f71f525fdb7500397939803a9b3.jpg saved to cache
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6420050>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_e9805a52fab04175ef295d6c1f5f2bfc.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_e9805a52fab04175ef295d6c1f5f2bfc.jpg saved to cache
2026-03-30 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_bbf5943c32eec3699523bdd0a6929346.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6ff6a10>
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F26%252F22264dbb48b47a36d52236a640a693e8%252Fpa%252FHZ87853_bbf5943c32eec3699523bdd0a6929346.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_bbf5943c32eec3699523bdd0a6929346.jpg saved to cache
2026-03-30 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad
2026-03-30 11:13:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad, skipping ID generation
2026-03-30 11:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with scrape type 1
2026-03-30 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad sending to next pipeline
2026-03-30 11:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad, identifier: HZ87853
2026-03-30 11:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with identifier: HZ87853
2026-03-30 11:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with identifier: HZ87853
2026-03-30 11:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with identifier: HZ87853 to the API
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_bbf5943c32eec3699523bdd0a6929346.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:06:58Z',
 'fuel_type': 'petrol',
 'id': '8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ87853',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 156716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_0be7b65139202e549081150805d42900.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_00b2bd247e4afeff7c3156f7a53b72fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_574e8c58096036119906e99494b416bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_e9805a52fab04175ef295d6c1f5f2bfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_46f37495291f527ba140e67a4bc21ad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_a48f7d1c55f30cbc1070c02b2cd4095b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_bbf5943c32eec3699523bdd0a6929346.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_acd688798c3f4025615eecd3370c92e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_f0f40f71f525fdb7500397939803a9b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad/8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/26/22264dbb48b47a36d52236a640a693e8/pa/HZ87853_a4bc168f23832845f975e678a618cd19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ87853%27 HTTP/1.1" 200 None
2026-03-30 11:13:46 [auto1.es] INFO: Saving data for HZ87853: {'created_time': 1774869226.57362, 'last_price_update_time': 1774869226.573631, 'auction_closing_time': 1774969618.0}
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HZ87853') HTTP/1.1" 204 0
2026-03-30 11:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:47 [auto1.es] INFO: Channel: 24h | Page: 15 | totalHits: 2207 | hits on page: 40
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: PS72870
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: KD33160
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD33160%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for KD33160: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: CT93709
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: WZ18115
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ18115%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for WZ18115: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: YT69856
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: AJ10793
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ10793%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for AJ10793: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: TR51915
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR51915%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for TR51915: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: UP08407
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: XD33524
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD33524%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for XD33524: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: ZT32060
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT32060%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for ZT32060: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: US86710
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US86710%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for US86710: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: ZC64439
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: XS01276
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS01276%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for XS01276: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: KX39687
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: ZD82589
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: GU11449
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: ET53098
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET53098%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for ET53098: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: AE81876
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: XN19340
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: YM13898
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: NR52566
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: BE54244
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: XC34643
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: TC87542
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: WU38219
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU38219%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for WU38219: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: XB87201
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB87201%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for XB87201: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: HV65502
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: LE33983
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: UU02684
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: FG09703
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: FX85730
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: MK12831
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: XH30785
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: ZM48966
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM48966%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for ZM48966: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: TA62942
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: VY65813
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY65813%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for VY65813: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: SK09082
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: MJ10048
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: MC76243
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC76243%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for MC76243: 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: FJ90358
2026-03-30 11:13:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR95745/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR95745> (referer: https://www.auto1.com/v1/car-details-view/MR95745/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc7b363-fc7b-53a6-a47e-1aac1de93f65 with identifier: MR95745
2026-03-30 11:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65 with scrape type 1
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_512a6389b9656adf5a225ba0279b5990.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_512a6389b9656adf5a225ba0279b5990.jpg not downloaded yet
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_532fe0ee88205e0dbc2d0756bd7a1bfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_532fe0ee88205e0dbc2d0756bd7a1bfa.jpg not downloaded yet
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_0e68b2264e101bb4758432d61cd37df1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_0e68b2264e101bb4758432d61cd37df1.jpg not downloaded yet
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_24099bc10881879342ec0424a8fa65a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_24099bc10881879342ec0424a8fa65a3.jpg not downloaded yet
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_ebdaad961555f63e244a9a8974decee4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_ebdaad961555f63e244a9a8974decee4.jpg not downloaded yet
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_686515c651e8052af7e6b6836991d20a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_686515c651e8052af7e6b6836991d20a.jpg not downloaded yet
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_c342275ad34c3056c2207eb76c5b5b05.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_c342275ad34c3056c2207eb76c5b5b05.jpg not downloaded yet
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_512a6389b9656adf5a225ba0279b5990.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_17000bd0996f56415b526b9fdbe57c13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_17000bd0996f56415b526b9fdbe57c13.jpg not downloaded yet
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_532fe0ee88205e0dbc2d0756bd7a1bfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_b1eabf92839f4a1c04faf8743cac426d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_b1eabf92839f4a1c04faf8743cac426d.jpg not downloaded yet
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_24099bc10881879342ec0424a8fa65a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_efcf029fab43f424a5eb872316e54fb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_efcf029fab43f424a5eb872316e54fb1.jpg not downloaded yet
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_0e68b2264e101bb4758432d61cd37df1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_ebdaad961555f63e244a9a8974decee4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc6de210>
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_512a6389b9656adf5a225ba0279b5990.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_512a6389b9656adf5a225ba0279b5990.jpg saved to cache
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_c342275ad34c3056c2207eb76c5b5b05.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_17000bd0996f56415b526b9fdbe57c13.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f55dd0>
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_532fe0ee88205e0dbc2d0756bd7a1bfa.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_532fe0ee88205e0dbc2d0756bd7a1bfa.jpg saved to cache
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f578d0>
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_24099bc10881879342ec0424a8fa65a3.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_24099bc10881879342ec0424a8fa65a3.jpg saved to cache
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_efcf029fab43f424a5eb872316e54fb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_b1eabf92839f4a1c04faf8743cac426d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc291450>
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_0e68b2264e101bb4758432d61cd37df1.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_0e68b2264e101bb4758432d61cd37df1.jpg saved to cache
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_686515c651e8052af7e6b6836991d20a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66802d0>
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_ebdaad961555f63e244a9a8974decee4.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_ebdaad961555f63e244a9a8974decee4.jpg saved to cache
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd006690>
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_c342275ad34c3056c2207eb76c5b5b05.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_c342275ad34c3056c2207eb76c5b5b05.jpg saved to cache
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc18db10>
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_17000bd0996f56415b526b9fdbe57c13.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_17000bd0996f56415b526b9fdbe57c13.jpg saved to cache
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65643d0>
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_efcf029fab43f424a5eb872316e54fb1.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_efcf029fab43f424a5eb872316e54fb1.jpg saved to cache
2026-03-30 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66f1c90>
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_b1eabf92839f4a1c04faf8743cac426d.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_b1eabf92839f4a1c04faf8743cac426d.jpg saved to cache
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb64015d0>
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc5%252Fb4c538b7dab8b14e61b39f6ebd585cbc%252Fpa%252FMR95745_686515c651e8052af7e6b6836991d20a.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_686515c651e8052af7e6b6836991d20a.jpg saved to cache
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65
2026-03-30 11:13:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3cc7b363-fc7b-53a6-a47e-1aac1de93f65, skipping ID generation
2026-03-30 11:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65 with scrape type 1
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3cc7b363-fc7b-53a6-a47e-1aac1de93f65 sending to next pipeline
2026-03-30 11:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3cc7b363-fc7b-53a6-a47e-1aac1de93f65, identifier: MR95745
2026-03-30 11:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3cc7b363-fc7b-53a6-a47e-1aac1de93f65 with identifier: MR95745
2026-03-30 11:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3cc7b363-fc7b-53a6-a47e-1aac1de93f65 with identifier: MR95745
2026-03-30 11:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3cc7b363-fc7b-53a6-a47e-1aac1de93f65 with identifier: MR95745 to the API
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_686515c651e8052af7e6b6836991d20a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:47Z',
 'fuel_type': 'diesel',
 'id': '3cc7b363-fc7b-53a6-a47e-1aac1de93f65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR95745',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 214508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_512a6389b9656adf5a225ba0279b5990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_532fe0ee88205e0dbc2d0756bd7a1bfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_0e68b2264e101bb4758432d61cd37df1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_24099bc10881879342ec0424a8fa65a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_ebdaad961555f63e244a9a8974decee4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_686515c651e8052af7e6b6836991d20a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_c342275ad34c3056c2207eb76c5b5b05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_17000bd0996f56415b526b9fdbe57c13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_b1eabf92839f4a1c04faf8743cac426d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc7b363-fc7b-53a6-a47e-1aac1de93f65/3cc7b363-fc7b-53a6-a47e-1aac1de93f65_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c5/b4c538b7dab8b14e61b39f6ebd585cbc/pa/MR95745_efcf029fab43f424a5eb872316e54fb1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Limousine 2.0 TDI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2019}
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR95745%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [auto1.es] INFO: Saving data for MR95745: {'created_time': 1774869233.659185, 'last_price_update_time': 1774869233.659197, 'auction_closing_time': 1774972007.0}
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MR95745') HTTP/1.1" 204 0
2026-03-30 11:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK75464> (referer: https://www.auto1.com/v1/car-details-view/ZK75464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with identifier: ZK75464
2026-03-30 11:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with scrape type 1
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_0876669f53a6eec950ca192459d0dfd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_0876669f53a6eec950ca192459d0dfd3.jpg not downloaded yet
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg not downloaded yet
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg not downloaded yet
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg not downloaded yet
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_c820d74a84816507cd15b5a6720e3eab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_c820d74a84816507cd15b5a6720e3eab.jpg not downloaded yet
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_2de7c6c2b7af324d50ace660864035cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_2de7c6c2b7af324d50ace660864035cf.jpg not downloaded yet
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg not downloaded yet
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_0876669f53a6eec950ca192459d0dfd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_6516848d0d855532e05003c3e764c300.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_6516848d0d855532e05003c3e764c300.jpg not downloaded yet
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_345033f2cd48f470218c6dcdab582f67.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_345033f2cd48f470218c6dcdab582f67.jpg not downloaded yet
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_30ecf96cfd46e371f64264677a82a28d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_30ecf96cfd46e371f64264677a82a28d.jpg not downloaded yet
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_30ecf96cfd46e371f64264677a82a28d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_345033f2cd48f470218c6dcdab582f67.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb65cb050>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_0876669f53a6eec950ca192459d0dfd3.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_0876669f53a6eec950ca192459d0dfd3.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6400090>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_c820d74a84816507cd15b5a6720e3eab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66e6590>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbc274390>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_30ecf96cfd46e371f64264677a82a28d.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_30ecf96cfd46e371f64264677a82a28d.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_2de7c6c2b7af324d50ace660864035cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_6516848d0d855532e05003c3e764c300.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb650c110>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_345033f2cd48f470218c6dcdab582f67.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_345033f2cd48f470218c6dcdab582f67.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cbd2d6350>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_c820d74a84816507cd15b5a6720e3eab.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_c820d74a84816507cd15b5a6720e3eab.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f56f10>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6461990>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_2de7c6c2b7af324d50ace660864035cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_2de7c6c2b7af324d50ace660864035cf.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb650c210>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_6516848d0d855532e05003c3e764c300.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_6516848d0d855532e05003c3e764c300.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f1a050>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F77%252F7477bd47cb8743da7de53b0e3b1b624c%252Fpa%252FZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-03-30 11:13:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd4dedf2-a8c3-567e-adcc-278005b6f0c8, skipping ID generation
2026-03-30 11:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with scrape type 1
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8 sending to next pipeline
2026-03-30 11:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd4dedf2-a8c3-567e-adcc-278005b6f0c8, identifier: ZK75464
2026-03-30 11:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with identifier: ZK75464
2026-03-30 11:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with identifier: ZK75464
2026-03-30 11:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with identifier: ZK75464 to the API
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:05:26Z',
 'fuel_type': 'diesel',
 'id': 'fd4dedf2-a8c3-567e-adcc-278005b6f0c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK75464',
 'listing': 'auction',
 'location': 'ES, Cornellà de Llobregat',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 232450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_0876669f53a6eec950ca192459d0dfd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_c820d74a84816507cd15b5a6720e3eab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_2de7c6c2b7af324d50ace660864035cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_6516848d0d855532e05003c3e764c300.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_345033f2cd48f470218c6dcdab582f67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_30ecf96cfd46e371f64264677a82a28d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CDI 4Matic BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK75464%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Saving data for ZK75464: {'created_time': 1774869236.247866, 'last_price_update_time': 1774869236.247881, 'auction_closing_time': 1774969526.0}
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZK75464') HTTP/1.1" 204 0
2026-03-30 11:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:56 [auto1.es] INFO: Channel: 24h | Page: 16 | totalHits: 2207 | hits on page: 40
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: DN61356
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN61356%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for DN61356: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: GF58352
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF58352%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for GF58352: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: RS73329
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: JL56851
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: DW89580
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW89580%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for DW89580: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: VL94048
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: LU76914
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: AA17148
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: YH68644
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: UR10895
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR10895%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for UR10895: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: XZ34869
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ34869%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for XZ34869: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: ZL13799
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL13799%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for ZL13799: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: PR87201
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: MJ09800
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: JL97970
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: TM82806
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM82806%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for TM82806: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: NE32180
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: PX21457
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX21457%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for PX21457: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: NC38071
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC38071%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for NC38071: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: KB34619
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: MY97846
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: EV84602
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: HG89264
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG89264%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for HG89264: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: NV08430
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV08430%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for NV08430: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: CG22215
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: EF44253
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: AE58330
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: CA16323
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: PY76001
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: YS16436
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: GD38057
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: XM10177
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM10177%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for XM10177: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: JW81079
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW81079%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for JW81079: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: KT28761
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: EJ87348
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ87348%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for EJ87348: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: MG81187
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG81187%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for MG81187: 0
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: BB78010
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: ZL69555
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: JY39879
2026-03-30 11:13:56 [auto1.es] INFO: Found listing with ID: HX96572
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX96572%27 HTTP/1.1" 200 None
2026-03-30 11:13:56 [auto1.es] INFO: Scrape type for HX96572: 0
2026-03-30 11:13:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:59 [auto1.es] INFO: Channel: 24h | Page: 17 | totalHits: 2207 | hits on page: 40
2026-03-30 11:13:59 [auto1.es] INFO: Found listing with ID: SS95298
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SS95298%27 HTTP/1.1" 200 None
2026-03-30 11:13:59 [auto1.es] INFO: Scrape type for SS95298: 0
2026-03-30 11:13:59 [auto1.es] INFO: Found listing with ID: CK47947
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK47947%27 HTTP/1.1" 200 None
2026-03-30 11:13:59 [auto1.es] INFO: Scrape type for CK47947: 0
2026-03-30 11:13:59 [auto1.es] INFO: Found listing with ID: DS79816
2026-03-30 11:13:59 [auto1.es] INFO: Found listing with ID: TU44986
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU44986%27 HTTP/1.1" 200 None
2026-03-30 11:13:59 [auto1.es] INFO: Scrape type for TU44986: 0
2026-03-30 11:13:59 [auto1.es] INFO: Found listing with ID: CG34681
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG34681%27 HTTP/1.1" 200 None
2026-03-30 11:13:59 [auto1.es] INFO: Scrape type for CG34681: 0
2026-03-30 11:13:59 [auto1.es] INFO: Found listing with ID: RC36042
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC36042%27 HTTP/1.1" 200 None
2026-03-30 11:13:59 [auto1.es] INFO: Scrape type for RC36042: 0
2026-03-30 11:13:59 [auto1.es] INFO: Found listing with ID: VC11143
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC11143%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for VC11143: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: YZ39389
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: YH22245
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: YH03872
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH03872%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for YH03872: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: CE52648
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE52648%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for CE52648: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: YZ96653
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: KG08685
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG08685%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for KG08685: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: GT40833
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: LF82591
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: XE21936
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: YT21640
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: XS13258
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: WT17927
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT17927%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for WT17927: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: NR71685
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: KW01886
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: HY48394
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: LG14006
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG14006%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for LG14006: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: CF95684
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: CT36127
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: DE32472
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE32472%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for DE32472: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: HP66589
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: CZ03495
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ03495%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for CZ03495: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: BV63051
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV63051%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for BV63051: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: WG88272
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: SA85956
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA85956%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for SA85956: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: BX69808
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX69808%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for BX69808: 0
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: UT85695
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT85695%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for UT85695: 1
2026-03-30 11:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:00 [auto1.es] INFO: Found listing with ID: YR51933
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR51933%27 HTTP/1.1" 200 None
2026-03-30 11:14:00 [auto1.es] INFO: Scrape type for YR51933: 2
2026-03-30 11:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71387d0a-a265-5668-9d72-b120c079730f with identifier: YR51933
2026-03-30 11:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71387d0a-a265-5668-9d72-b120c079730f with scrape type 2
2026-03-30 11:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71387d0a-a265-5668-9d72-b120c079730f with scrape type 2
2026-03-30 11:14:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 71387d0a-a265-5668-9d72-b120c079730f, identifier: YR51933
2026-03-30 11:14:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 71387d0a-a265-5668-9d72-b120c079730f with identifier: YR51933
2026-03-30 11:14:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 71387d0a-a265-5668-9d72-b120c079730f with identifier: YR51933
2026-03-30 11:14:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 71387d0a-a265-5668-9d72-b120c079730f with identifier: YR51933 to the API
2026-03-30 11:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-31T15:52:30Z',
 'fuel_type': 'diesel',
 'id': '71387d0a-a265-5668-9d72-b120c079730f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR51933',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 322231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-17',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2013}
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR51933%27 HTTP/1.1" 200 None
2026-03-30 11:14:01 [auto1.es] INFO: Saving data for YR51933: {'auction_closing_time': 1774972350.0, 'created_time': 1773130646.414515, 'last_price_update_time': 1774869241.274478}
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YR51933') HTTP/1.1" 204 0
2026-03-30 11:14:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:01 [auto1.es] INFO: Found listing with ID: JP02584
2026-03-30 11:14:01 [auto1.es] INFO: Found listing with ID: VC56562
2026-03-30 11:14:01 [auto1.es] INFO: Found listing with ID: HF45963
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF45963%27 HTTP/1.1" 200 None
2026-03-30 11:14:01 [auto1.es] INFO: Scrape type for HF45963: 2
2026-03-30 11:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with identifier: HF45963
2026-03-30 11:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with scrape type 2
2026-03-30 11:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with scrape type 2
2026-03-30 11:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1, identifier: HF45963
2026-03-30 11:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with identifier: HF45963
2026-03-30 11:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with identifier: HF45963
2026-03-30 11:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with identifier: HF45963 to the API
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:39:48Z',
 'fuel_type': 'diesel',
 'id': '8fec7e7d-df2b-5d4b-9bb5-073dc282afa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF45963',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 153319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2017}
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF45963%27 HTTP/1.1" 200 None
2026-03-30 11:14:01 [auto1.es] INFO: Saving data for HF45963: {'auction_closing_time': 1774971588.0, 'created_time': 1773129220.619375, 'last_price_update_time': 1774869241.850059}
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HF45963') HTTP/1.1" 204 0
2026-03-30 11:14:01 [auto1.es] INFO: Found listing with ID: AC83489
2026-03-30 11:14:01 [auto1.es] INFO: Found listing with ID: MC39832
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC39832%27 HTTP/1.1" 200 None
2026-03-30 11:14:01 [auto1.es] INFO: Scrape type for MC39832: 2
2026-03-30 11:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82eebf0-759e-5572-8f1c-2f6a1b397c8b with identifier: MC39832
2026-03-30 11:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82eebf0-759e-5572-8f1c-2f6a1b397c8b with scrape type 2
2026-03-30 11:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c82eebf0-759e-5572-8f1c-2f6a1b397c8b with scrape type 2
2026-03-30 11:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c82eebf0-759e-5572-8f1c-2f6a1b397c8b, identifier: MC39832
2026-03-30 11:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c82eebf0-759e-5572-8f1c-2f6a1b397c8b with identifier: MC39832
2026-03-30 11:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c82eebf0-759e-5572-8f1c-2f6a1b397c8b with identifier: MC39832
2026-03-30 11:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c82eebf0-759e-5572-8f1c-2f6a1b397c8b with identifier: MC39832 to the API
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:18:23Z',
 'fuel_type': 'petrol',
 'id': 'c82eebf0-759e-5572-8f1c-2f6a1b397c8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC39832',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 51853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-14',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Klass',
 'transmission': 'manual',
 'trim': 'Klass',
 'year': 2019}
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC39832%27 HTTP/1.1" 200 None
2026-03-30 11:14:02 [auto1.es] INFO: Saving data for MC39832: {'auction_closing_time': 1774970303.0, 'created_time': 1773691256.59634, 'last_price_update_time': 1774869242.309464}
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MC39832') HTTP/1.1" 204 0
2026-03-30 11:14:02 [auto1.es] INFO: Found listing with ID: KL41152
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL41152%27 HTTP/1.1" 200 None
2026-03-30 11:14:02 [auto1.es] INFO: Scrape type for KL41152: 2
2026-03-30 11:14:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932f7490-4768-5758-bc8f-55a064e47494 with identifier: KL41152
2026-03-30 11:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932f7490-4768-5758-bc8f-55a064e47494 with scrape type 2
2026-03-30 11:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932f7490-4768-5758-bc8f-55a064e47494 with scrape type 2
2026-03-30 11:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 932f7490-4768-5758-bc8f-55a064e47494, identifier: KL41152
2026-03-30 11:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 932f7490-4768-5758-bc8f-55a064e47494 with identifier: KL41152
2026-03-30 11:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 932f7490-4768-5758-bc8f-55a064e47494 with identifier: KL41152
2026-03-30 11:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 932f7490-4768-5758-bc8f-55a064e47494 with identifier: KL41152 to the API
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:59Z',
 'fuel_type': 'diesel',
 'id': '932f7490-4768-5758-bc8f-55a064e47494',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL41152',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 115195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Advance BlueMotion',
 'transmission': 'automatic',
 'trim': 'Advance BlueMotion',
 'year': 2020}
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL41152%27 HTTP/1.1" 200 None
2026-03-30 11:14:02 [auto1.es] INFO: Saving data for KL41152: {'auction_closing_time': 1774971839.0, 'created_time': 1773126990.543131, 'last_price_update_time': 1774869242.931501}
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KL41152') HTTP/1.1" 204 0
2026-03-30 11:14:04 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 18 pages/min), scraped 204 items (at 13 items/min)
2026-03-30 11:14:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:06 [auto1.es] INFO: Channel: 24h | Page: 18 | totalHits: 2207 | hits on page: 40
2026-03-30 11:14:06 [auto1.es] INFO: Found listing with ID: BB01662
2026-03-30 11:14:06 [auto1.es] INFO: Found listing with ID: AP37450
2026-03-30 11:14:06 [auto1.es] INFO: Found listing with ID: CX56846
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX56846%27 HTTP/1.1" 200 None
2026-03-30 11:14:06 [auto1.es] INFO: Scrape type for CX56846: 2
2026-03-30 11:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 573163cb-cda8-5bd0-94a5-311c6d266ff1 with identifier: CX56846
2026-03-30 11:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 573163cb-cda8-5bd0-94a5-311c6d266ff1 with scrape type 2
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 573163cb-cda8-5bd0-94a5-311c6d266ff1 with scrape type 2
2026-03-30 11:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 573163cb-cda8-5bd0-94a5-311c6d266ff1, identifier: CX56846
2026-03-30 11:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 573163cb-cda8-5bd0-94a5-311c6d266ff1 with identifier: CX56846
2026-03-30 11:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 573163cb-cda8-5bd0-94a5-311c6d266ff1 with identifier: CX56846
2026-03-30 11:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 573163cb-cda8-5bd0-94a5-311c6d266ff1 with identifier: CX56846 to the API
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:21:54Z',
 'fuel_type': 'diesel',
 'id': '573163cb-cda8-5bd0-94a5-311c6d266ff1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX56846',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 228242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Confort XL',
 'transmission': 'manual',
 'trim': 'Confort XL',
 'year': 2018}
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX56846%27 HTTP/1.1" 200 None
2026-03-30 11:14:06 [auto1.es] INFO: Saving data for CX56846: {'auction_closing_time': 1774970514.0, 'created_time': 1773756194.662175, 'last_price_update_time': 1774869246.936723}
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CX56846') HTTP/1.1" 204 0
2026-03-30 11:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:06 [auto1.es] INFO: Found listing with ID: YC93687
2026-03-30 11:14:06 [auto1.es] INFO: Found listing with ID: JR98843
2026-03-30 11:14:06 [auto1.es] INFO: Found listing with ID: HR03779
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR03779%27 HTTP/1.1" 200 None
2026-03-30 11:14:06 [auto1.es] INFO: Scrape type for HR03779: 2
2026-03-30 11:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97a918c7-3a8a-5222-a2b5-bd427410029a with identifier: HR03779
2026-03-30 11:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97a918c7-3a8a-5222-a2b5-bd427410029a with scrape type 2
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97a918c7-3a8a-5222-a2b5-bd427410029a with scrape type 2
2026-03-30 11:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97a918c7-3a8a-5222-a2b5-bd427410029a, identifier: HR03779
2026-03-30 11:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97a918c7-3a8a-5222-a2b5-bd427410029a with identifier: HR03779
2026-03-30 11:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97a918c7-3a8a-5222-a2b5-bd427410029a with identifier: HR03779
2026-03-30 11:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97a918c7-3a8a-5222-a2b5-bd427410029a with identifier: HR03779 to the API
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:18:28Z',
 'fuel_type': 'petrol',
 'id': '97a918c7-3a8a-5222-a2b5-bd427410029a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR03779',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 168405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-07',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Concept 2WD',
 'transmission': 'manual',
 'trim': 'Concept 2WD',
 'year': 2018}
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR03779%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [auto1.es] INFO: Saving data for HR03779: {'auction_closing_time': 1774970308.0, 'created_time': 1772627518.562857, 'last_price_update_time': 1774869247.466215}
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HR03779') HTTP/1.1" 204 0
2026-03-30 11:14:07 [auto1.es] INFO: Found listing with ID: XB03866
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB03866%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [auto1.es] INFO: Scrape type for XB03866: 2
2026-03-30 11:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cebed96-49aa-568e-b5b5-21f493ff663f with identifier: XB03866
2026-03-30 11:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cebed96-49aa-568e-b5b5-21f493ff663f with scrape type 2
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cebed96-49aa-568e-b5b5-21f493ff663f with scrape type 2
2026-03-30 11:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6cebed96-49aa-568e-b5b5-21f493ff663f, identifier: XB03866
2026-03-30 11:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6cebed96-49aa-568e-b5b5-21f493ff663f with identifier: XB03866
2026-03-30 11:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6cebed96-49aa-568e-b5b5-21f493ff663f with identifier: XB03866
2026-03-30 11:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6cebed96-49aa-568e-b5b5-21f493ff663f with identifier: XB03866 to the API
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:13:24Z',
 'fuel_type': 'petrol',
 'id': '6cebed96-49aa-568e-b5b5-21f493ff663f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB03866',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 142385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Feel Pack',
 'transmission': 'manual',
 'trim': 'Feel Pack',
 'year': 2022}
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB03866%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [auto1.es] INFO: Saving data for XB03866: {'auction_closing_time': 1774970004.0, 'created_time': 1774382687.436747, 'last_price_update_time': 1774869248.175074}
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB03866') HTTP/1.1" 204 0
2026-03-30 11:14:08 [auto1.es] INFO: Found listing with ID: BA38537
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA38537%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [auto1.es] INFO: Scrape type for BA38537: 2
2026-03-30 11:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a28a26-4cc7-5bda-b848-5401f8b374e5 with identifier: BA38537
2026-03-30 11:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a28a26-4cc7-5bda-b848-5401f8b374e5 with scrape type 2
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47a28a26-4cc7-5bda-b848-5401f8b374e5 with scrape type 2
2026-03-30 11:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 47a28a26-4cc7-5bda-b848-5401f8b374e5, identifier: BA38537
2026-03-30 11:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 47a28a26-4cc7-5bda-b848-5401f8b374e5 with identifier: BA38537
2026-03-30 11:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 47a28a26-4cc7-5bda-b848-5401f8b374e5 with identifier: BA38537
2026-03-30 11:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 47a28a26-4cc7-5bda-b848-5401f8b374e5 with identifier: BA38537 to the API
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:25:57Z',
 'fuel_type': 'petrol',
 'id': '47a28a26-4cc7-5bda-b848-5401f8b374e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA38537',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 167376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'R 4Motion BlueMotion Tech',
 'year': 2014}
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA38537%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [auto1.es] INFO: Saving data for BA38537: {'auction_closing_time': 1774970757.0, 'created_time': 1774274572.951834, 'last_price_update_time': 1774869248.616232}
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BA38537') HTTP/1.1" 204 0
2026-03-30 11:14:08 [auto1.es] INFO: Found listing with ID: CK45240
2026-03-30 11:14:08 [auto1.es] INFO: Found listing with ID: VZ76792
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ76792%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [auto1.es] INFO: Scrape type for VZ76792: 2
2026-03-30 11:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with identifier: VZ76792
2026-03-30 11:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with scrape type 2
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with scrape type 2
2026-03-30 11:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e, identifier: VZ76792
2026-03-30 11:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with identifier: VZ76792
2026-03-30 11:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with identifier: VZ76792
2026-03-30 11:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with identifier: VZ76792 to the API
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:39:38Z',
 'fuel_type': 'diesel',
 'id': 'f6be9cc1-df1b-54c1-9f97-db99eaf33c0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ76792',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 129695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-02',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi XTR Plus',
 'transmission': 'manual',
 'trim': 'XTR Plus',
 'year': 2015}
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ76792%27 HTTP/1.1" 200 None
2026-03-30 11:14:09 [auto1.es] INFO: Saving data for VZ76792: {'auction_closing_time': 1774971578.0, 'created_time': 1773128718.204098, 'last_price_update_time': 1774869249.085406}
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VZ76792') HTTP/1.1" 204 0
2026-03-30 11:14:09 [auto1.es] INFO: Found listing with ID: PA54206
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA54206%27 HTTP/1.1" 200 None
2026-03-30 11:14:09 [auto1.es] INFO: Scrape type for PA54206: 1
2026-03-30 11:14:09 [auto1.es] INFO: Found listing with ID: SD12171
2026-03-30 11:14:09 [auto1.es] INFO: Found listing with ID: LD06220
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD06220%27 HTTP/1.1" 200 None
2026-03-30 11:14:09 [auto1.es] INFO: Scrape type for LD06220: 2
2026-03-30 11:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c64fc96a-0b93-560f-8fc9-6ae7aa4a0737 with identifier: LD06220
2026-03-30 11:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c64fc96a-0b93-560f-8fc9-6ae7aa4a0737 with scrape type 2
2026-03-30 11:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c64fc96a-0b93-560f-8fc9-6ae7aa4a0737 with scrape type 2
2026-03-30 11:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c64fc96a-0b93-560f-8fc9-6ae7aa4a0737, identifier: LD06220
2026-03-30 11:14:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c64fc96a-0b93-560f-8fc9-6ae7aa4a0737 with identifier: LD06220
2026-03-30 11:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c64fc96a-0b93-560f-8fc9-6ae7aa4a0737 with identifier: LD06220
2026-03-30 11:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c64fc96a-0b93-560f-8fc9-6ae7aa4a0737 with identifier: LD06220 to the API
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:12:03Z',
 'fuel_type': 'diesel',
 'id': 'c64fc96a-0b93-560f-8fc9-6ae7aa4a0737',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD06220',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 345685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-30',
 'seller_name': None,
 'title': 'Volkswagen Jetta 1.9 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2006}
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD06220%27 HTTP/1.1" 200 None
2026-03-30 11:14:09 [auto1.es] INFO: Saving data for LD06220: {'auction_closing_time': 1774969923.0, 'created_time': 1774382571.350152, 'last_price_update_time': 1774869249.557958}
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LD06220') HTTP/1.1" 204 0
2026-03-30 11:14:09 [auto1.es] INFO: Found listing with ID: GU84067
2026-03-30 11:14:09 [auto1.es] INFO: Found listing with ID: MD67818
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD67818%27 HTTP/1.1" 200 None
2026-03-30 11:14:09 [auto1.es] INFO: Scrape type for MD67818: 2
2026-03-30 11:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24d2d9c7-4216-50c0-a4d4-29db14772312 with identifier: MD67818
2026-03-30 11:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24d2d9c7-4216-50c0-a4d4-29db14772312 with scrape type 2
2026-03-30 11:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24d2d9c7-4216-50c0-a4d4-29db14772312 with scrape type 2
2026-03-30 11:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24d2d9c7-4216-50c0-a4d4-29db14772312, identifier: MD67818
2026-03-30 11:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24d2d9c7-4216-50c0-a4d4-29db14772312 with identifier: MD67818
2026-03-30 11:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24d2d9c7-4216-50c0-a4d4-29db14772312 with identifier: MD67818
2026-03-30 11:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24d2d9c7-4216-50c0-a4d4-29db14772312 with identifier: MD67818 to the API
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:25:23Z',
 'fuel_type': 'diesel',
 'id': '24d2d9c7-4216-50c0-a4d4-29db14772312',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD67818',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 218450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-25',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD67818%27 HTTP/1.1" 200 None
2026-03-30 11:14:09 [auto1.es] INFO: Saving data for MD67818: {'auction_closing_time': 1774970723.0, 'created_time': 1773144843.538839, 'last_price_update_time': 1774869249.991524}
2026-03-30 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MD67818') HTTP/1.1" 204 0
2026-03-30 11:14:10 [auto1.es] INFO: Found listing with ID: SR27128
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR27128%27 HTTP/1.1" 200 None
2026-03-30 11:14:10 [auto1.es] INFO: Scrape type for SR27128: 1
2026-03-30 11:14:10 [auto1.es] INFO: Found listing with ID: MD90485
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD90485%27 HTTP/1.1" 200 None
2026-03-30 11:14:10 [auto1.es] INFO: Scrape type for MD90485: 2
2026-03-30 11:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee27e38-d604-519c-9f58-00f85c09ee91 with identifier: MD90485
2026-03-30 11:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee27e38-d604-519c-9f58-00f85c09ee91 with scrape type 2
2026-03-30 11:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bee27e38-d604-519c-9f58-00f85c09ee91 with scrape type 2
2026-03-30 11:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bee27e38-d604-519c-9f58-00f85c09ee91, identifier: MD90485
2026-03-30 11:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bee27e38-d604-519c-9f58-00f85c09ee91 with identifier: MD90485
2026-03-30 11:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bee27e38-d604-519c-9f58-00f85c09ee91 with identifier: MD90485
2026-03-30 11:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bee27e38-d604-519c-9f58-00f85c09ee91 with identifier: MD90485 to the API
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:49:37Z',
 'fuel_type': 'diesel',
 'id': 'bee27e38-d604-519c-9f58-00f85c09ee91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD90485',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 251614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-21',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2009}
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD90485%27 HTTP/1.1" 200 None
2026-03-30 11:14:10 [auto1.es] INFO: Saving data for MD90485: {'auction_closing_time': 1774972177.0, 'created_time': 1773128898.034356, 'last_price_update_time': 1774869250.453341}
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MD90485') HTTP/1.1" 204 0
2026-03-30 11:14:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:10 [auto1.es] INFO: Found listing with ID: NA59815
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA59815%27 HTTP/1.1" 200 None
2026-03-30 11:14:10 [auto1.es] INFO: Scrape type for NA59815: 1
2026-03-30 11:14:10 [auto1.es] INFO: Found listing with ID: SH24939
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH24939%27 HTTP/1.1" 200 None
2026-03-30 11:14:10 [auto1.es] INFO: Scrape type for SH24939: 1
2026-03-30 11:14:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:10 [auto1.es] INFO: Found listing with ID: AV50831
2026-03-30 11:14:10 [auto1.es] INFO: Found listing with ID: WM54096
2026-03-30 11:14:10 [auto1.es] INFO: Found listing with ID: JW31558
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW31558%27 HTTP/1.1" 200 None
2026-03-30 11:14:10 [auto1.es] INFO: Scrape type for JW31558: 2
2026-03-30 11:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac3d66a-8bae-52d3-9443-caaa77036dea with identifier: JW31558
2026-03-30 11:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac3d66a-8bae-52d3-9443-caaa77036dea with scrape type 2
2026-03-30 11:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dac3d66a-8bae-52d3-9443-caaa77036dea with scrape type 2
2026-03-30 11:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dac3d66a-8bae-52d3-9443-caaa77036dea, identifier: JW31558
2026-03-30 11:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dac3d66a-8bae-52d3-9443-caaa77036dea with identifier: JW31558
2026-03-30 11:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dac3d66a-8bae-52d3-9443-caaa77036dea with identifier: JW31558
2026-03-30 11:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dac3d66a-8bae-52d3-9443-caaa77036dea with identifier: JW31558 to the API
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:49:48Z',
 'fuel_type': 'petrol',
 'id': 'dac3d66a-8bae-52d3-9443-caaa77036dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW31558',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 17143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-25',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.2 PureTech Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2024}
2026-03-30 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW31558%27 HTTP/1.1" 200 None
2026-03-30 11:14:11 [auto1.es] INFO: Saving data for JW31558: {'auction_closing_time': 1774972188.0, 'created_time': 1774609312.60357, 'last_price_update_time': 1774869251.050842}
2026-03-30 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW31558') HTTP/1.1" 204 0
2026-03-30 11:14:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:11 [auto1.es] INFO: Found listing with ID: JD23550
2026-03-30 11:14:11 [auto1.es] INFO: Found listing with ID: HX74648
2026-03-30 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX74648%27 HTTP/1.1" 200 None
2026-03-30 11:14:11 [auto1.es] INFO: Scrape type for HX74648: 2
2026-03-30 11:14:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddac0db5-a34d-5a27-928c-23fc83381f2b with identifier: HX74648
2026-03-30 11:14:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddac0db5-a34d-5a27-928c-23fc83381f2b with scrape type 2
2026-03-30 11:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddac0db5-a34d-5a27-928c-23fc83381f2b with scrape type 2
2026-03-30 11:14:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ddac0db5-a34d-5a27-928c-23fc83381f2b, identifier: HX74648
2026-03-30 11:14:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ddac0db5-a34d-5a27-928c-23fc83381f2b with identifier: HX74648
2026-03-30 11:14:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ddac0db5-a34d-5a27-928c-23fc83381f2b with identifier: HX74648
2026-03-30 11:14:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ddac0db5-a34d-5a27-928c-23fc83381f2b with identifier: HX74648 to the API
2026-03-30 11:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:06:24Z',
 'fuel_type': 'petrol',
 'id': 'ddac0db5-a34d-5a27-928c-23fc83381f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX74648',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 65501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Essence 2WD',
 'transmission': 'manual',
 'trim': 'Essence 2WD',
 'year': 2019}
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX74648%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Saving data for HX74648: {'auction_closing_time': 1774969584.0, 'created_time': 1773126729.414153, 'last_price_update_time': 1774869252.215979}
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HX74648') HTTP/1.1" 204 0
2026-03-30 11:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: GJ05293
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: GM40947
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM40947%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Scrape type for GM40947: 2
2026-03-30 11:14:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5141ef0e-998f-59fc-8041-e160ae2d6bed with identifier: GM40947
2026-03-30 11:14:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5141ef0e-998f-59fc-8041-e160ae2d6bed with scrape type 2
2026-03-30 11:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5141ef0e-998f-59fc-8041-e160ae2d6bed with scrape type 2
2026-03-30 11:14:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5141ef0e-998f-59fc-8041-e160ae2d6bed, identifier: GM40947
2026-03-30 11:14:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5141ef0e-998f-59fc-8041-e160ae2d6bed with identifier: GM40947
2026-03-30 11:14:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5141ef0e-998f-59fc-8041-e160ae2d6bed with identifier: GM40947
2026-03-30 11:14:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5141ef0e-998f-59fc-8041-e160ae2d6bed with identifier: GM40947 to the API
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:24:01Z',
 'fuel_type': 'diesel',
 'id': '5141ef0e-998f-59fc-8041-e160ae2d6bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM40947',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 199194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2015}
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM40947%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Saving data for GM40947: {'auction_closing_time': 1774970641.0, 'created_time': 1774090828.202423, 'last_price_update_time': 1774869252.818669}
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GM40947') HTTP/1.1" 204 0
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: LN73643
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: FH96205
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: XT23333
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: PY60818
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY60818%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Scrape type for PY60818: 0
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: FS16711
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: PE83631
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE83631%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Scrape type for PE83631: 0
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: HB69486
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB69486%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Scrape type for HB69486: 0
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: GL45539
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: TS74128
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: DF81839
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF81839%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Scrape type for DF81839: 0
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: AB03508
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: LJ76960
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ76960%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Scrape type for LJ76960: 0
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: XN68994
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: AY38423
2026-03-30 11:14:12 [auto1.es] INFO: Channel: 24h | Page: 19 | totalHits: 2207 | hits on page: 40
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: LE58276
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE58276%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Scrape type for LE58276: 0
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: TV56423
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV56423%27 HTTP/1.1" 200 None
2026-03-30 11:14:12 [auto1.es] INFO: Scrape type for TV56423: 0
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: NH02350
2026-03-30 11:14:12 [auto1.es] INFO: Found listing with ID: HY00110
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY00110%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for HY00110: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: BK02277
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK02277%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for BK02277: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: HU62060
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: ZH31692
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH31692%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for ZH31692: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: FC86593
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC86593%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for FC86593: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: KV49695
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV49695%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for KV49695: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: AG88258
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: TE03576
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: LP64738
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: HX04467
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: NG91820
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: CH18424
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: BP46708
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP46708%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for BP46708: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: GW46978
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW46978%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for GW46978: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: ZA22926
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: DH89256
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: HT29464
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT29464%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for HT29464: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: AR83818
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR83818%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for AR83818: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: EB95108
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: PR72166
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: AZ96253
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ96253%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for AZ96253: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: WK92895
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK92895%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for WK92895: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: DN29660
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: MW98976
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW98976%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for MW98976: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: EH00837
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH00837%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for EH00837: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: MZ63101
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ63101%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for MZ63101: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: NA64654
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA64654%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for NA64654: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: SF48857
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: NK96984
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK96984%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for NK96984: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: CS79839
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS79839%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for CS79839: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: NA59982
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: SA96918
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: AV99168
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: NX58407
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX58407%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.es] INFO: Scrape type for NX58407: 0
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: EA93149
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: BF07220
2026-03-30 11:14:13 [auto1.es] INFO: Found listing with ID: UA87015
2026-03-30 11:14:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH24939/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:25 [auto1.es] INFO: Channel: 24h | Page: 20 | totalHits: 2207 | hits on page: 40
2026-03-30 11:14:25 [auto1.es] INFO: Found listing with ID: EA60639
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA60639%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.es] INFO: Scrape type for EA60639: 0
2026-03-30 11:14:25 [auto1.es] INFO: Found listing with ID: LS25075
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS25075%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for LS25075: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: UX02026
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: AU64639
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU64639%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for AU64639: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: ZV35449
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV35449%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for ZV35449: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: KS53937
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: VW16333
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW16333%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for VW16333: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: CV42273
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV42273%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for CV42273: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: NZ35550
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: XA46112
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: SP63286
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: NN81936
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: HY05176
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: YZ74298
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: AZ69629
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ69629%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for AZ69629: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: VJ45850
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ45850%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for VJ45850: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: WZ01367
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: PU93239
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU93239%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for PU93239: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: PL32115
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: PN79224
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: WY32728
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: BZ61067
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ61067%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for BZ61067: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: WG12182
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG12182%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for WG12182: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: CY99272
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY99272%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for CY99272: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: MD02288
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: FF03006
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: YK64988
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: XN99288
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: YC05678
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC05678%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for YC05678: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: TG79405
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: VV17373
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV17373%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for VV17373: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: FD45689
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD45689%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for FD45689: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: CJ82848
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ82848%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for CJ82848: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: GG14242
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG14242%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for GG14242: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: RY07165
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: ST22726
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: KH66285
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH66285%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.es] INFO: Scrape type for KH66285: 0
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: JG48293
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: TE76337
2026-03-30 11:14:26 [auto1.es] INFO: Found listing with ID: NV56765
2026-03-30 11:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:34 [auto1.es] INFO: Channel: 24h | Page: 21 | totalHits: 2207 | hits on page: 40
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: EB04007
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB04007%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for EB04007: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: MN37580
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN37580%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for MN37580: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: SZ88467
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ88467%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for SZ88467: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: VE30170
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE30170%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for VE30170: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: YK84517
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK84517%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for YK84517: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: RC23930
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: FE10852
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE10852%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for FE10852: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: US42967
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: BE81339
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: LY48125
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY48125%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for LY48125: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: WB05226
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: UB14006
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB14006%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for UB14006: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: GU63395
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: BJ99702
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: EB56604
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: DH28057
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: GD98283
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: TC80522
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC80522%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for TC80522: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: LZ88302
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ88302%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for LZ88302: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: DY37922
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY37922%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for DY37922: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: EN63751
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: HU51946
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU51946%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for HU51946: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: MY21675
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY21675%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for MY21675: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: DM30321
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM30321%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for DM30321: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: MF88912
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: VD62527
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: KT14312
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: XY66822
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY66822%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for XY66822: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: HX94185
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: BU39967
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: JR90206
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: ZV85818
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV85818%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for ZV85818: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: TU86062
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: UB19878
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: PM58195
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM58195%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for PM58195: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: AC51222
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: SH51429
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH51429%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for SH51429: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: YC02097
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: WL81576
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL81576%27 HTTP/1.1" 200 None
2026-03-30 11:14:34 [auto1.es] INFO: Scrape type for WL81576: 0
2026-03-30 11:14:34 [auto1.es] INFO: Found listing with ID: GA87794
2026-03-30 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA87794%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.es] INFO: Scrape type for GA87794: 0
2026-03-30 11:14:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:47 [auto1.es] INFO: Channel: 24h | Page: 22 | totalHits: 2208 | hits on page: 40
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: GA87794
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA87794%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for GA87794: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: BK88638
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK88638%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for BK88638: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: ZG69122
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: SD38157
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD38157%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for SD38157: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: AA76120
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA76120%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for AA76120: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: TZ07439
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: KW46470
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW46470%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for KW46470: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: ZN44479
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN44479%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for ZN44479: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: NH78008
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: TD74034
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD74034%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for TD74034: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: PV00531
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: GC96055
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC96055%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for GC96055: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: ND56377
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND56377%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for ND56377: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: GZ15438
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ15438%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for GZ15438: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: LC47472
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: WA43088
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: VH20399
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH20399%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for VH20399: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: LA93651
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: VC14240
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: AT48913
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: DF05847
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF05847%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [auto1.es] INFO: Scrape type for DF05847: 0
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: CG28095
2026-03-30 11:14:47 [auto1.es] INFO: Found listing with ID: LX79959
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX79959%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for LX79959: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: HP65934
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP65934%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for HP65934: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: DZ57590
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: AH06396
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: AE39465
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: CS85139
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: RK09278
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK09278%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for RK09278: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: FU02845
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU02845%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for FU02845: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: EV44292
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV44292%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for EV44292: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: RD73162
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD73162%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for RD73162: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: BE99512
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: BB81076
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: NA90839
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA90839%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for NA90839: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: WC01421
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC01421%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for WC01421: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: HU09823
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU09823%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for HU09823: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: WJ13616
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13616%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for WJ13616: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: ET29682
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET29682%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for ET29682: 0
2026-03-30 11:14:48 [auto1.es] INFO: Found listing with ID: KY66855
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY66855%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.es] INFO: Scrape type for KY66855: 0
2026-03-30 11:14:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:04 [scrapy.extensions.logstats] INFO: Crawled 175 pages (at 7 pages/min), scraped 215 items (at 11 items/min)
2026-03-30 11:15:04 [auto1.es] INFO: Channel: 24h | Page: 23 | totalHits: 2208 | hits on page: 40
2026-03-30 11:15:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: WU13655
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU13655%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for WU13655: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: XX88726
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: AL56115
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL56115%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for AL56115: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: EB91308
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB91308%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for EB91308: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: ZN38628
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: LD31555
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD31555%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for LD31555: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: VC21709
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: UB23509
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB23509%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for UB23509: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: PY68884
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY68884%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for PY68884: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: UZ31378
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: FM17704
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM17704%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for FM17704: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: EK01872
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: YK67948
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK67948%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for YK67948: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: XS72165
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: AR38034
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR38034%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for AR38034: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: DE05142
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: DS85202
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS85202%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for DS85202: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: CM29886
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM29886%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for CM29886: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: LC59414
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC59414%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for LC59414: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: ZR92434
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: XM72121
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: KH78289
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: HT97347
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT97347%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for HT97347: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: NK89716
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK89716%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for NK89716: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: TG59620
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG59620%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for TG59620: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: XP83718
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP83718%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for XP83718: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: VR19230
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR19230%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for VR19230: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: YN09707
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: EM25182
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM25182%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for EM25182: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: UX56252
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX56252%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for UX56252: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: NF01026
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: CP47935
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP47935%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for CP47935: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: AJ17622
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: ZW84948
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW84948%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for ZW84948: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: WP34960
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP34960%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for WP34960: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: YE69993
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: ZU63673
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: UX61881
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX61881%27 HTTP/1.1" 200 None
2026-03-30 11:15:04 [auto1.es] INFO: Scrape type for UX61881: 0
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: PK27651
2026-03-30 11:15:04 [auto1.es] INFO: Found listing with ID: PD89077
2026-03-30 11:15:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:22 [auto1.es] INFO: Channel: 24h | Page: 24 | totalHits: 2208 | hits on page: 40
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: LF16630
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: XG19134
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: RZ25182
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ25182%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for RZ25182: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: PP58388
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP58388%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for PP58388: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: YF58100
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF58100%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for YF58100: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: EY27652
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY27652%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for EY27652: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: LV66931
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV66931%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for LV66931: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: GN42445
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: SE46424
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE46424%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for SE46424: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: TY04306
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: ZP90682
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: RA15604
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: WA04361
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: MP20353
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: WZ80502
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ80502%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for WZ80502: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: DT92878
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: GU07092
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: EN30281
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN30281%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for EN30281: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: LD85215
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: DF95857
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: AR99640
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR99640%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for AR99640: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: FW12550
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW12550%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for FW12550: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: YC26234
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: WU95928
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU95928%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for WU95928: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: EZ00387
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: PA70803
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: ZL27489
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: CL01909
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL01909%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for CL01909: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: RM87129
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM87129%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for RM87129: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: JF80642
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: AN61719
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN61719%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for AN61719: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: RW86694
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW86694%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for RW86694: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: YH76219
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH76219%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for YH76219: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: ET49532
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET49532%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for ET49532: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: PH24007
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: BA72384
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA72384%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for BA72384: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: XL49074
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL49074%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for XL49074: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: NV97141
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: RC69280
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC69280%27 HTTP/1.1" 200 None
2026-03-30 11:15:22 [auto1.es] INFO: Scrape type for RC69280: 0
2026-03-30 11:15:22 [auto1.es] INFO: Found listing with ID: JP06939
2026-03-30 11:15:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:58 [auto1.es] INFO: Channel: 24h | Page: 25 | totalHits: 2208 | hits on page: 40
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: KC55308
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: RU72076
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: HS23075
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: LS24467
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS24467%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for LS24467: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: SL05666
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL05666%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for SL05666: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: UJ75834
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ75834%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for UJ75834: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: NL18277
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL18277%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for NL18277: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: WC31685
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC31685%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for WC31685: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: YJ31594
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: AL95022
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL95022%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for AL95022: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: YH50380
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH50380%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for YH50380: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: DR80408
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR80408%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for DR80408: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: KN20480
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN20480%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for KN20480: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: AZ32576
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ32576%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for AZ32576: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: EL87448
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL87448%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for EL87448: 0
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: RM32032
2026-03-30 11:15:58 [auto1.es] INFO: Found listing with ID: NW70780
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW70780%27 HTTP/1.1" 200 None
2026-03-30 11:15:58 [auto1.es] INFO: Scrape type for NW70780: 2
2026-03-30 11:15:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5556890-7959-5859-a5a7-a86d3db0027a with identifier: NW70780
2026-03-30 11:15:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5556890-7959-5859-a5a7-a86d3db0027a with scrape type 2
2026-03-30 11:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5556890-7959-5859-a5a7-a86d3db0027a with scrape type 2
2026-03-30 11:15:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c5556890-7959-5859-a5a7-a86d3db0027a, identifier: NW70780
2026-03-30 11:15:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c5556890-7959-5859-a5a7-a86d3db0027a with identifier: NW70780
2026-03-30 11:15:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c5556890-7959-5859-a5a7-a86d3db0027a with identifier: NW70780
2026-03-30 11:15:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c5556890-7959-5859-a5a7-a86d3db0027a with identifier: NW70780 to the API
2026-03-30 11:15:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:27Z',
 'fuel_type': 'diesel',
 'id': 'c5556890-7959-5859-a5a7-a86d3db0027a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW70780',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 124082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-13',
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2023}
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW70780%27 HTTP/1.1" 200 None
2026-03-30 11:16:00 [auto1.es] INFO: Saving data for NW70780: {'auction_closing_time': 1774884927.0, 'created_time': 1773147734.60544, 'last_price_update_time': 1774869360.301005}
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NW70780') HTTP/1.1" 204 0
2026-03-30 11:16:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:00 [auto1.es] INFO: Found listing with ID: AE38479
2026-03-30 11:16:00 [auto1.es] INFO: Found listing with ID: RX75701
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX75701%27 HTTP/1.1" 200 None
2026-03-30 11:16:00 [auto1.es] INFO: Scrape type for RX75701: 0
2026-03-30 11:16:00 [auto1.es] INFO: Found listing with ID: AM40954
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM40954%27 HTTP/1.1" 200 None
2026-03-30 11:16:00 [auto1.es] INFO: Scrape type for AM40954: 0
2026-03-30 11:16:00 [auto1.es] INFO: Found listing with ID: NY63856
2026-03-30 11:16:00 [auto1.es] INFO: Found listing with ID: FE95499
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE95499%27 HTTP/1.1" 200 None
2026-03-30 11:16:00 [auto1.es] INFO: Scrape type for FE95499: 2
2026-03-30 11:16:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6e24d59-050d-5def-984d-77bc21b7cc2f with identifier: FE95499
2026-03-30 11:16:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e24d59-050d-5def-984d-77bc21b7cc2f with scrape type 2
2026-03-30 11:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6e24d59-050d-5def-984d-77bc21b7cc2f with scrape type 2
2026-03-30 11:16:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6e24d59-050d-5def-984d-77bc21b7cc2f, identifier: FE95499
2026-03-30 11:16:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6e24d59-050d-5def-984d-77bc21b7cc2f with identifier: FE95499
2026-03-30 11:16:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6e24d59-050d-5def-984d-77bc21b7cc2f with identifier: FE95499
2026-03-30 11:16:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e6e24d59-050d-5def-984d-77bc21b7cc2f with identifier: FE95499 to the API
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:08:15Z',
 'fuel_type': 'diesel',
 'id': 'e6e24d59-050d-5def-984d-77bc21b7cc2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE95499',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 135922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 M-Jet Furgón SX',
 'transmission': 'manual',
 'trim': 'Furgón SX',
 'year': 2020}
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE95499%27 HTTP/1.1" 200 None
2026-03-30 11:16:00 [auto1.es] INFO: Saving data for FE95499: {'auction_closing_time': 1774883295.0, 'created_time': 1774361328.908387, 'last_price_update_time': 1774869360.826669}
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FE95499') HTTP/1.1" 204 0
2026-03-30 11:16:00 [auto1.es] INFO: Found listing with ID: NZ75467
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ75467%27 HTTP/1.1" 200 None
2026-03-30 11:16:00 [auto1.es] INFO: Scrape type for NZ75467: 2
2026-03-30 11:16:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03f5c048-d266-5403-b2f5-7e80523b0560 with identifier: NZ75467
2026-03-30 11:16:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03f5c048-d266-5403-b2f5-7e80523b0560 with scrape type 2
2026-03-30 11:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03f5c048-d266-5403-b2f5-7e80523b0560 with scrape type 2
2026-03-30 11:16:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 03f5c048-d266-5403-b2f5-7e80523b0560, identifier: NZ75467
2026-03-30 11:16:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 03f5c048-d266-5403-b2f5-7e80523b0560 with identifier: NZ75467
2026-03-30 11:16:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 03f5c048-d266-5403-b2f5-7e80523b0560 with identifier: NZ75467
2026-03-30 11:16:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 03f5c048-d266-5403-b2f5-7e80523b0560 with identifier: NZ75467 to the API
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:57:32Z',
 'fuel_type': 'diesel',
 'id': '03f5c048-d266-5403-b2f5-7e80523b0560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ75467',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 197927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-17',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2019}
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ75467%27 HTTP/1.1" 200 None
2026-03-30 11:16:01 [auto1.es] INFO: Saving data for NZ75467: {'auction_closing_time': 1774886252.0, 'created_time': 1774782021.712966, 'last_price_update_time': 1774869361.266605}
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NZ75467') HTTP/1.1" 204 0
2026-03-30 11:16:01 [auto1.es] INFO: Found listing with ID: UA78056
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA78056%27 HTTP/1.1" 200 None
2026-03-30 11:16:01 [auto1.es] INFO: Scrape type for UA78056: 2
2026-03-30 11:16:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9b33125-eef7-57be-b146-8a333b888acf with identifier: UA78056
2026-03-30 11:16:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b33125-eef7-57be-b146-8a333b888acf with scrape type 2
2026-03-30 11:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9b33125-eef7-57be-b146-8a333b888acf with scrape type 2
2026-03-30 11:16:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9b33125-eef7-57be-b146-8a333b888acf, identifier: UA78056
2026-03-30 11:16:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9b33125-eef7-57be-b146-8a333b888acf with identifier: UA78056
2026-03-30 11:16:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9b33125-eef7-57be-b146-8a333b888acf with identifier: UA78056
2026-03-30 11:16:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9b33125-eef7-57be-b146-8a333b888acf with identifier: UA78056 to the API
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:09:13Z',
 'fuel_type': 'petrol',
 'id': 'd9b33125-eef7-57be-b146-8a333b888acf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA78056',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 51574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-19',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Concept",
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2021}
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA78056%27 HTTP/1.1" 200 None
2026-03-30 11:16:01 [auto1.es] INFO: Saving data for UA78056: {'auction_closing_time': 1774883353.0, 'created_time': 1773132571.568609, 'last_price_update_time': 1774869361.852238}
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UA78056') HTTP/1.1" 204 0
2026-03-30 11:16:01 [auto1.es] INFO: Found listing with ID: ZJ91904
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ91904%27 HTTP/1.1" 200 None
2026-03-30 11:16:01 [auto1.es] INFO: Scrape type for ZJ91904: 2
2026-03-30 11:16:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224d14b9-8119-5fde-8147-0c67c2a43195 with identifier: ZJ91904
2026-03-30 11:16:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224d14b9-8119-5fde-8147-0c67c2a43195 with scrape type 2
2026-03-30 11:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224d14b9-8119-5fde-8147-0c67c2a43195 with scrape type 2
2026-03-30 11:16:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 224d14b9-8119-5fde-8147-0c67c2a43195, identifier: ZJ91904
2026-03-30 11:16:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 224d14b9-8119-5fde-8147-0c67c2a43195 with identifier: ZJ91904
2026-03-30 11:16:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 224d14b9-8119-5fde-8147-0c67c2a43195 with identifier: ZJ91904
2026-03-30 11:16:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 224d14b9-8119-5fde-8147-0c67c2a43195 with identifier: ZJ91904 to the API
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:03:13Z',
 'fuel_type': 'petrol',
 'id': '224d14b9-8119-5fde-8147-0c67c2a43195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ91904',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 141977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-18',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ91904%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Saving data for ZJ91904: {'auction_closing_time': 1774882993.0, 'created_time': 1774782022.588138, 'last_price_update_time': 1774869362.282098}
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZJ91904') HTTP/1.1" 204 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: AS89718
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: LP19075
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP19075%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for LP19075: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: NX10542
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX10542%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for NX10542: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: UJ63738
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: MR44374
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR44374%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for MR44374: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: TF01145
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF01145%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for TF01145: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: FD92504
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: VK23822
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK23822%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for VK23822: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: TW05387
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW05387%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for TW05387: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: KY97566
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY97566%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for KY97566: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: SW56668
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW56668%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for SW56668: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: SA01398
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA01398%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for SA01398: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: WE89333
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE89333%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for WE89333: 0
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: HD33844
2026-03-30 11:16:02 [auto1.es] INFO: Found listing with ID: VG19877
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19877%27 HTTP/1.1" 200 None
2026-03-30 11:16:02 [auto1.es] INFO: Scrape type for VG19877: 0
2026-03-30 11:16:04 [scrapy.extensions.logstats] INFO: Crawled 177 pages (at 2 pages/min), scraped 220 items (at 5 items/min)
2026-03-30 11:16:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:16:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.018(s), this was the 1st time calling it.
2026-03-30 11:16:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.171455162496718 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.313(s), this was the 1st time calling it.
2026-03-30 11:16:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.279481548656465 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.036(s), this was the 1st time calling it.
2026-03-30 11:16:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.08278600785405 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.996(s), this was the 1st time calling it.
2026-03-30 11:16:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.341823351887087 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT85695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT85695> (referer: https://www.auto1.com/v1/car-details-view/UT85695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f8c04e-cafd-5ce5-80db-2c18dbc3f30b with identifier: UT85695
2026-03-30 11:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f8c04e-cafd-5ce5-80db-2c18dbc3f30b with scrape type 1
2026-03-30 11:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 52f8c04e-cafd-5ce5-80db-2c18dbc3f30b
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffb%252F72fb142c7912d3419898bcdd0ed684c8%252Fpa%252FUT85695_80651438506eb14dfb8ad3fa58be3793.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_80651438506eb14dfb8ad3fa58be3793.jpg already downloaded
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffb%252F72fb142c7912d3419898bcdd0ed684c8%252Fpa%252FUT85695_96de2f6e8c9a5318cadf657e2fc7cb54.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_96de2f6e8c9a5318cadf657e2fc7cb54.jpg already downloaded
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffb%252F72fb142c7912d3419898bcdd0ed684c8%252Fpa%252FUT85695_1b69fdd620544e61724d5a10f85b59ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_1b69fdd620544e61724d5a10f85b59ba.jpg already downloaded
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffb%252F72fb142c7912d3419898bcdd0ed684c8%252Fpa%252FUT85695_eb582bc6615d0e1dac8d4841dca6336d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_eb582bc6615d0e1dac8d4841dca6336d.jpg already downloaded
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffb%252F72fb142c7912d3419898bcdd0ed684c8%252Fpa%252FUT85695_6eb63722cc9b9249ebdfaad50ea3bd21.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_6eb63722cc9b9249ebdfaad50ea3bd21.jpg already downloaded
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffb%252F72fb142c7912d3419898bcdd0ed684c8%252Fpa%252FUT85695_681467212c4abaa5fa911cfcf7e2e9ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_681467212c4abaa5fa911cfcf7e2e9ec.jpg already downloaded
2026-03-30 11:16:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52f8c04e-cafd-5ce5-80db-2c18dbc3f30b, identifier: UT85695
2026-03-30 11:16:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52f8c04e-cafd-5ce5-80db-2c18dbc3f30b with identifier: UT85695
2026-03-30 11:16:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52f8c04e-cafd-5ce5-80db-2c18dbc3f30b with identifier: UT85695
2026-03-30 11:16:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 52f8c04e-cafd-5ce5-80db-2c18dbc3f30b with identifier: UT85695 to the API
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT85695>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:44:55Z',
 'fuel_type': 'petrol',
 'id': '52f8c04e-cafd-5ce5-80db-2c18dbc3f30b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT85695',
 'listing': 'auction',
 'location': 'ES, Atarfe, Granada',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 196167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_80651438506eb14dfb8ad3fa58be3793.jpg',
                'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_96de2f6e8c9a5318cadf657e2fc7cb54.jpg',
                'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_1b69fdd620544e61724d5a10f85b59ba.jpg',
                'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_eb582bc6615d0e1dac8d4841dca6336d.jpg',
                'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_6eb63722cc9b9249ebdfaad50ea3bd21.jpg',
                'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_681467212c4abaa5fa911cfcf7e2e9ec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f8c04e-cafd-5ce5-80db-2c18dbc3f30b/52f8c04e-cafd-5ce5-80db-2c18dbc3f30b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_80651438506eb14dfb8ad3fa58be3793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f8c04e-cafd-5ce5-80db-2c18dbc3f30b/52f8c04e-cafd-5ce5-80db-2c18dbc3f30b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_96de2f6e8c9a5318cadf657e2fc7cb54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f8c04e-cafd-5ce5-80db-2c18dbc3f30b/52f8c04e-cafd-5ce5-80db-2c18dbc3f30b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_1b69fdd620544e61724d5a10f85b59ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f8c04e-cafd-5ce5-80db-2c18dbc3f30b/52f8c04e-cafd-5ce5-80db-2c18dbc3f30b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_eb582bc6615d0e1dac8d4841dca6336d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f8c04e-cafd-5ce5-80db-2c18dbc3f30b/52f8c04e-cafd-5ce5-80db-2c18dbc3f30b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_6eb63722cc9b9249ebdfaad50ea3bd21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f8c04e-cafd-5ce5-80db-2c18dbc3f30b/52f8c04e-cafd-5ce5-80db-2c18dbc3f30b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/fb/72fb142c7912d3419898bcdd0ed684c8/pa/UT85695_681467212c4abaa5fa911cfcf7e2e9ec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Laguna 2.0 Turbo Privilege',
 'transmission': 'manual',
 'trim': 'Privilege',
 'year': 2005}
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT85695%27 HTTP/1.1" 200 None
2026-03-30 11:16:26 [auto1.es] INFO: Saving data for UT85695: {'created_time': 1774869386.644534, 'last_price_update_time': 1774869386.644545, 'auction_closing_time': 1774971895.0}
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT85695') HTTP/1.1" 204 0
2026-03-30 11:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR27128/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA54206/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.400(s), this was the 1st time calling it.
2026-03-30 11:16:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.55124737922749 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:36 [auto1.es] INFO: Channel: 24h | Page: 26 | totalHits: 2209 | hits on page: 40
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: VG19877
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19877%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for VG19877: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: UX63556
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX63556%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for UX63556: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: SS93372
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: FV55100
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV55100%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for FV55100: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: HN69450
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN69450%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for HN69450: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: VZ14573
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ14573%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for VZ14573: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: DZ68037
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ68037%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for DZ68037: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: WD91964
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: HU91100
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU91100%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for HU91100: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: GK24659
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK24659%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for GK24659: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: RV68054
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV68054%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for RV68054: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: EZ62755
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: PS51318
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS51318%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for PS51318: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: RA40828
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA40828%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for RA40828: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: MX89388
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: DG60223
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG60223%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for DG60223: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: KV08902
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: UN46915
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: ZJ66849
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: BY62424
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY62424%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for BY62424: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: ZP40388
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP40388%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for ZP40388: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: UU12950
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU12950%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for UU12950: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: JC57024
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC57024%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for JC57024: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: NK53544
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: MS50562
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS50562%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for MS50562: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: TP39679
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: FL58713
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: FE45976
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: FD06451
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: SY03135
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: BZ30426
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ30426%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for BZ30426: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: VG29597
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: JM67207
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM67207%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for JM67207: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: JG31489
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: LL39817
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL39817%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for LL39817: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: BG65437
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG65437%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for BG65437: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: PC57749
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: SW39850
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW39850%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for SW39850: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: UT42800
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT42800%27 HTTP/1.1" 200 None
2026-03-30 11:16:36 [auto1.es] INFO: Scrape type for UT42800: 0
2026-03-30 11:16:36 [auto1.es] INFO: Found listing with ID: XT05924
2026-03-30 11:16:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR27128> (referer: https://www.auto1.com/v1/car-details-view/SR27128/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 095889c3-c714-5b23-a3ef-0bd89d631d4f with identifier: SR27128
2026-03-30 11:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 095889c3-c714-5b23-a3ef-0bd89d631d4f with scrape type 1
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 095889c3-c714-5b23-a3ef-0bd89d631d4f
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_a34b6ad339078a27f14be56f1081d6c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_a34b6ad339078a27f14be56f1081d6c7.jpg already downloaded
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_429e6696de2eea0c20f2d76c8a23a990.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_429e6696de2eea0c20f2d76c8a23a990.jpg already downloaded
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_cdc6f7f9ca430923629ac1cc34eb6d00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_cdc6f7f9ca430923629ac1cc34eb6d00.jpg already downloaded
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_a9aa2470b38c557a342aa5ebd87330cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_a9aa2470b38c557a342aa5ebd87330cb.jpg already downloaded
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_277609e6b3aa02a4c72f8fb0b4c4f2bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_277609e6b3aa02a4c72f8fb0b4c4f2bd.jpg already downloaded
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_e95c2985e813e3f051e048aea093a836.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_e95c2985e813e3f051e048aea093a836.jpg already downloaded
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_384698205039cdec908e5ad2d0b43b4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_384698205039cdec908e5ad2d0b43b4e.jpg already downloaded
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_843597819efe049345d8d455839af649.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_843597819efe049345d8d455839af649.jpg already downloaded
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_868cf74fe35ada0b71b2cb4f4c3d3e22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_868cf74fe35ada0b71b2cb4f4c3d3e22.jpg already downloaded
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff2%252F1df2d39c5d2407aa1e5eac8f6573a354%252Fpa%252FSR27128_3b7f7b1f95f062b5ad69b156d524ad09.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_3b7f7b1f95f062b5ad69b156d524ad09.jpg already downloaded
2026-03-30 11:16:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 095889c3-c714-5b23-a3ef-0bd89d631d4f, identifier: SR27128
2026-03-30 11:16:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 095889c3-c714-5b23-a3ef-0bd89d631d4f with identifier: SR27128
2026-03-30 11:16:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 095889c3-c714-5b23-a3ef-0bd89d631d4f with identifier: SR27128
2026-03-30 11:16:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 095889c3-c714-5b23-a3ef-0bd89d631d4f with identifier: SR27128 to the API
2026-03-30 11:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR27128>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:26:29Z',
 'fuel_type': 'diesel',
 'id': '095889c3-c714-5b23-a3ef-0bd89d631d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR27128',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 159291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_a34b6ad339078a27f14be56f1081d6c7.jpg',
                'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_429e6696de2eea0c20f2d76c8a23a990.jpg',
                'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_cdc6f7f9ca430923629ac1cc34eb6d00.jpg',
                'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_a9aa2470b38c557a342aa5ebd87330cb.jpg',
                'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_277609e6b3aa02a4c72f8fb0b4c4f2bd.jpg',
                'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_e95c2985e813e3f051e048aea093a836.jpg',
                'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_384698205039cdec908e5ad2d0b43b4e.jpg',
                'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_843597819efe049345d8d455839af649.jpg',
                'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_868cf74fe35ada0b71b2cb4f4c3d3e22.jpg',
                'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_3b7f7b1f95f062b5ad69b156d524ad09.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_a34b6ad339078a27f14be56f1081d6c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_429e6696de2eea0c20f2d76c8a23a990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_cdc6f7f9ca430923629ac1cc34eb6d00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_a9aa2470b38c557a342aa5ebd87330cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_277609e6b3aa02a4c72f8fb0b4c4f2bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_e95c2985e813e3f051e048aea093a836.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_384698205039cdec908e5ad2d0b43b4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_843597819efe049345d8d455839af649.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_868cf74fe35ada0b71b2cb4f4c3d3e22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_095889c3-c714-5b23-a3ef-0bd89d631d4f/095889c3-c714-5b23-a3ef-0bd89d631d4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f2/1df2d39c5d2407aa1e5eac8f6573a354/pa/SR27128_3b7f7b1f95f062b5ad69b156d524ad09.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.6 CDTI Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2018}
2026-03-30 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR27128%27 HTTP/1.1" 200 None
2026-03-30 11:16:44 [auto1.es] INFO: Saving data for SR27128: {'created_time': 1774869404.377246, 'last_price_update_time': 1774869404.377257, 'auction_closing_time': 1774970789.0}
2026-03-30 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SR27128') HTTP/1.1" 204 0
2026-03-30 11:16:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH24939> (referer: https://www.auto1.com/v1/car-details-view/SH24939/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee with identifier: SH24939
2026-03-30 11:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee with scrape type 1
2026-03-30 11:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa6%252F99a672c80cf25c16fe25b58183264902%252Fpa%252FSH24939_3733586ef2d8ac1e1a3305d885f9f848.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_3733586ef2d8ac1e1a3305d885f9f848.jpg already downloaded
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa6%252F99a672c80cf25c16fe25b58183264902%252Fpa%252FSH24939_506914f4fb4a3b845886c579959cb37f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_506914f4fb4a3b845886c579959cb37f.jpg already downloaded
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa6%252F99a672c80cf25c16fe25b58183264902%252Fpa%252FSH24939_f3facf1d49a8a8e82c462b8eff5ebcb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_f3facf1d49a8a8e82c462b8eff5ebcb1.jpg already downloaded
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa6%252F99a672c80cf25c16fe25b58183264902%252Fpa%252FSH24939_8e57d6cac344a45a4472281ae3c64553.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_8e57d6cac344a45a4472281ae3c64553.jpg already downloaded
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa6%252F99a672c80cf25c16fe25b58183264902%252Fpa%252FSH24939_3e76d2e1fa9747be5c70be1d94087ada.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_3e76d2e1fa9747be5c70be1d94087ada.jpg already downloaded
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa6%252F99a672c80cf25c16fe25b58183264902%252Fpa%252FSH24939_8d7a55a8e2da4a9d41408ba9d65ed7e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_8d7a55a8e2da4a9d41408ba9d65ed7e5.jpg already downloaded
2026-03-30 11:16:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee, identifier: SH24939
2026-03-30 11:16:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee with identifier: SH24939
2026-03-30 11:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee with identifier: SH24939
2026-03-30 11:16:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee with identifier: SH24939 to the API
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SH24939>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:20:36Z',
 'fuel_type': 'diesel',
 'id': '91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH24939',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 235939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_3733586ef2d8ac1e1a3305d885f9f848.jpg',
                'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_506914f4fb4a3b845886c579959cb37f.jpg',
                'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_f3facf1d49a8a8e82c462b8eff5ebcb1.jpg',
                'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_8e57d6cac344a45a4472281ae3c64553.jpg',
                'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_3e76d2e1fa9747be5c70be1d94087ada.jpg',
                'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_8d7a55a8e2da4a9d41408ba9d65ed7e5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee/91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_3733586ef2d8ac1e1a3305d885f9f848.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee/91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_506914f4fb4a3b845886c579959cb37f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee/91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_f3facf1d49a8a8e82c462b8eff5ebcb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee/91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_8e57d6cac344a45a4472281ae3c64553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee/91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_3e76d2e1fa9747be5c70be1d94087ada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee/91b3fa3d-7b9d-5f55-87c4-4d8947fc07ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a6/99a672c80cf25c16fe25b58183264902/pa/SH24939_8d7a55a8e2da4a9d41408ba9d65ed7e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH24939%27 HTTP/1.1" 200 None
2026-03-30 11:16:45 [auto1.es] INFO: Saving data for SH24939: {'created_time': 1774869405.995249, 'last_price_update_time': 1774869405.995263, 'auction_closing_time': 1774970436.0}
2026-03-30 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SH24939') HTTP/1.1" 204 0
2026-03-30 11:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:55 [auto1.es] INFO: Channel: 24h | Page: 27 | totalHits: 2209 | hits on page: 40
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: UF24863
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF24863%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.es] INFO: Scrape type for UF24863: 0
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: TR37642
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR37642%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.es] INFO: Scrape type for TR37642: 0
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: ZP69611
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: PY01338
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY01338%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.es] INFO: Scrape type for PY01338: 0
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: FZ59891
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: GM36563
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM36563%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.es] INFO: Scrape type for GM36563: 0
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: ET47712
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET47712%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.es] INFO: Scrape type for ET47712: 0
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: CM69790
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: NH22970
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: CR05055
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: DD59936
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD59936%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.es] INFO: Scrape type for DD59936: 0
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: EC26628
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC26628%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.es] INFO: Scrape type for EC26628: 0
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: UF51281
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: DD26500
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD26500%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.es] INFO: Scrape type for DD26500: 0
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: DB30998
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: BF77799
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF77799%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.es] INFO: Scrape type for BF77799: 0
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: FY93718
2026-03-30 11:16:55 [auto1.es] INFO: Found listing with ID: DW27115
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW27115%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for DW27115: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: ED81509
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED81509%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for ED81509: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: RZ43075
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ43075%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for RZ43075: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: RK31949
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: JJ21664
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ21664%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for JJ21664: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: BA69170
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: DA42101
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA42101%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for DA42101: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: MV61216
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: GK85431
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK85431%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for GK85431: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: EX41974
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX41974%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for EX41974: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: AV79521
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV79521%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for AV79521: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: LR65108
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR65108%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for LR65108: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: XL90476
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL90476%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for XL90476: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: CF79242
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: ZZ15598
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: TF16142
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: CW38943
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: CY26712
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY26712%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for CY26712: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: MT83895
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT83895%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for MT83895: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: EA09271
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: EW06270
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW06270%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.es] INFO: Scrape type for EW06270: 0
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: TW27527
2026-03-30 11:16:56 [auto1.es] INFO: Found listing with ID: GU79254
2026-03-30 11:16:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:04 [scrapy.extensions.logstats] INFO: Crawled 185 pages (at 8 pages/min), scraped 223 items (at 3 items/min)
2026-03-30 11:17:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:12 [auto1.es] INFO: Channel: 24h | Page: 28 | totalHits: 2209 | hits on page: 40
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: EY19176
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY19176%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for EY19176: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: FV38056
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: DA52344
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: DG19356
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: WA77291
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: HP73598
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: TY10266
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: SE47115
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: FX89085
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX89085%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for FX89085: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: DR86630
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR86630%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for DR86630: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: ZR58264
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR58264%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for ZR58264: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: CU50273
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: YG41867
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: JN05964
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: FM76074
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: ZN83644
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: RR71682
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR71682%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for RR71682: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: KT37897
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: UH51284
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH51284%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for UH51284: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: BR06094
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: XV67448
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: DM90018
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: JS89296
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS89296%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for JS89296: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: FK22292
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: XH26332
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: HG08189
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: BU83574
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: JH71842
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: WV17945
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV17945%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for WV17945: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: DT10330
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: SH03418
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH03418%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for SH03418: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: BS83179
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: UP80890
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP80890%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for UP80890: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: DG65204
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG65204%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for DG65204: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: WN13849
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN13849%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for WN13849: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: GD28297
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: PK59036
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: SL79064
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: UB76587
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB76587%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.es] INFO: Scrape type for UB76587: 0
2026-03-30 11:17:12 [auto1.es] INFO: Found listing with ID: XD48344
2026-03-30 11:17:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:04 [scrapy.extensions.logstats] INFO: Crawled 186 pages (at 1 pages/min), scraped 223 items (at 0 items/min)
2026-03-30 11:18:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:22 [auto1.es] INFO: Channel: 24h | Page: 29 | totalHits: 2211 | hits on page: 40
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: UB76587
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB76587%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Scrape type for UB76587: 0
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: XD48344
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: UV16090
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: WL36526
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL36526%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Scrape type for WL36526: 0
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: AU46465
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: XK54532
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK54532%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Scrape type for XK54532: 0
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: PZ76479
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ76479%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Scrape type for PZ76479: 0
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: LD13903
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD13903%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Scrape type for LD13903: 0
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: HR86968
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR86968%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Scrape type for HR86968: 0
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: FG99809
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG99809%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Scrape type for FG99809: 0
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: VN33770
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN33770%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Scrape type for VN33770: 0
2026-03-30 11:18:22 [auto1.es] INFO: Found listing with ID: LC68552
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC68552%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Scrape type for LC68552: 2
2026-03-30 11:18:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9168094-5b71-5196-aba9-ecb18553ee77 with identifier: LC68552
2026-03-30 11:18:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9168094-5b71-5196-aba9-ecb18553ee77 with scrape type 2
2026-03-30 11:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9168094-5b71-5196-aba9-ecb18553ee77 with scrape type 2
2026-03-30 11:18:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9168094-5b71-5196-aba9-ecb18553ee77, identifier: LC68552
2026-03-30 11:18:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9168094-5b71-5196-aba9-ecb18553ee77 with identifier: LC68552
2026-03-30 11:18:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9168094-5b71-5196-aba9-ecb18553ee77 with identifier: LC68552
2026-03-30 11:18:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9168094-5b71-5196-aba9-ecb18553ee77 with identifier: LC68552 to the API
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:09Z',
 'fuel_type': 'petrol',
 'id': 'f9168094-5b71-5196-aba9-ecb18553ee77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC68552',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 276117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-30',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2009}
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC68552%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Saving data for LC68552: {'auction_closing_time': 1774886109.0, 'created_time': 1773127273.995024, 'last_price_update_time': 1774869502.89204}
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LC68552') HTTP/1.1" 204 0
2026-03-30 11:18:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: RG83636
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG83636%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for RG83636: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: XT97336
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: CM19424
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM19424%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for CM19424: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: CP78264
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP78264%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for CP78264: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: NR18889
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR18889%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for NR18889: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: BD30925
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: JR87984
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: YE53281
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE53281%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for YE53281: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: XL11781
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL11781%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for XL11781: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: TU71868
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: KE29048
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: SZ79556
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: ZV95361
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV95361%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for ZV95361: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: TT67656
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: WA75456
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA75456%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for WA75456: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: ME86804
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: WM80180
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM80180%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for WM80180: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: DY56989
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: XS16270
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: NE82558
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: WA73273
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: TP06770
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: JG96257
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG96257%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for JG96257: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: XX73025
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: KL57529
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: CH60945
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH60945%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for CH60945: 0
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: UV28052
2026-03-30 11:18:23 [auto1.es] INFO: Found listing with ID: WK61099
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK61099%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Scrape type for WK61099: 0
2026-03-30 11:18:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.211(s), this was the 2nd time calling it.
2026-03-30 11:18:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.748859803604585 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:18:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.978(s), this was the 1st time calling it.
2026-03-30 11:18:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.467478791185151 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:18:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:18:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA54206> (referer: https://www.auto1.com/v1/car-details-view/PA54206/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24736fc-7265-5e35-a0fb-c84fdc36cf1b with identifier: PA54206
2026-03-30 11:18:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24736fc-7265-5e35-a0fb-c84fdc36cf1b with scrape type 1
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c24736fc-7265-5e35-a0fb-c84fdc36cf1b
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_11e1bcc4a53319f3369a12d78a5d6f83.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_11e1bcc4a53319f3369a12d78a5d6f83.jpg already downloaded
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_db26f030f826f030992abf31be6aba58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_db26f030f826f030992abf31be6aba58.jpg already downloaded
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_812aae6b99dd0fc401b380996f347915.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_812aae6b99dd0fc401b380996f347915.jpg already downloaded
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_70753d8b0ac90d7f139f9d943eb956b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_70753d8b0ac90d7f139f9d943eb956b3.jpg already downloaded
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_74b1776a2df85d61df901e4ffff90db5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_74b1776a2df85d61df901e4ffff90db5.jpg already downloaded
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_feeec83b94590e03d1862294efcd941d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_feeec83b94590e03d1862294efcd941d.jpg already downloaded
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_da474f476010ce9a319c01e20746d5d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_da474f476010ce9a319c01e20746d5d0.jpg already downloaded
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_e45a3a15a381da39958899aefae38fdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_e45a3a15a381da39958899aefae38fdd.jpg already downloaded
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_f72a2368d486f560edd75d53df255be6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_f72a2368d486f560edd75d53df255be6.jpg already downloaded
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe8%252F94e897d30c3f79d65203c2fc09283711%252Fpa%252FPA54206_8dbd0870fd57fdf3cd8dd40b4b02943e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_8dbd0870fd57fdf3cd8dd40b4b02943e.jpg already downloaded
2026-03-30 11:18:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c24736fc-7265-5e35-a0fb-c84fdc36cf1b, identifier: PA54206
2026-03-30 11:18:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c24736fc-7265-5e35-a0fb-c84fdc36cf1b with identifier: PA54206
2026-03-30 11:18:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c24736fc-7265-5e35-a0fb-c84fdc36cf1b with identifier: PA54206
2026-03-30 11:18:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c24736fc-7265-5e35-a0fb-c84fdc36cf1b with identifier: PA54206 to the API
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PA54206>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:47Z',
 'fuel_type': 'diesel',
 'id': 'c24736fc-7265-5e35-a0fb-c84fdc36cf1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA54206',
 'listing': 'auction',
 'location': 'ES, La Pobla de Valbona',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 326310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_11e1bcc4a53319f3369a12d78a5d6f83.jpg',
                'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_db26f030f826f030992abf31be6aba58.jpg',
                'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_812aae6b99dd0fc401b380996f347915.jpg',
                'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_70753d8b0ac90d7f139f9d943eb956b3.jpg',
                'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_74b1776a2df85d61df901e4ffff90db5.jpg',
                'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_feeec83b94590e03d1862294efcd941d.jpg',
                'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_da474f476010ce9a319c01e20746d5d0.jpg',
                'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_e45a3a15a381da39958899aefae38fdd.jpg',
                'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_f72a2368d486f560edd75d53df255be6.jpg',
                'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_8dbd0870fd57fdf3cd8dd40b4b02943e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_11e1bcc4a53319f3369a12d78a5d6f83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_db26f030f826f030992abf31be6aba58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_812aae6b99dd0fc401b380996f347915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_70753d8b0ac90d7f139f9d943eb956b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_74b1776a2df85d61df901e4ffff90db5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_feeec83b94590e03d1862294efcd941d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_da474f476010ce9a319c01e20746d5d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_e45a3a15a381da39958899aefae38fdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_f72a2368d486f560edd75d53df255be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24736fc-7265-5e35-a0fb-c84fdc36cf1b/c24736fc-7265-5e35-a0fb-c84fdc36cf1b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e8/94e897d30c3f79d65203c2fc09283711/pa/PA54206_8dbd0870fd57fdf3cd8dd40b4b02943e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2016}
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA54206%27 HTTP/1.1" 200 None
2026-03-30 11:18:54 [auto1.es] INFO: Saving data for PA54206: {'created_time': 1774869534.513155, 'last_price_update_time': 1774869534.513164, 'auction_closing_time': 1774972487.0}
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PA54206') HTTP/1.1" 204 0
2026-03-30 11:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA59815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:04 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 3 pages/min), scraped 225 items (at 2 items/min)
2026-03-30 11:19:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:20:04 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 225 items (at 0 items/min)
2026-03-30 11:20:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:20:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.493(s), this was the 1st time calling it.
2026-03-30 11:20:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.938183904116373 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:20:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:21:04 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 0 pages/min), scraped 225 items (at 0 items/min)
2026-03-30 11:21:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:21:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.121(s), this was the 1st time calling it.
2026-03-30 11:21:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.219292694955683 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:21:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA59815> (referer: https://www.auto1.com/v1/car-details-view/NA59815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7b39c8-5b10-5dff-b24c-68831f75e0f3 with identifier: NA59815
2026-03-30 11:21:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7b39c8-5b10-5dff-b24c-68831f75e0f3 with scrape type 1
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e7b39c8-5b10-5dff-b24c-68831f75e0f3
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_cbb3305314b0b54cb2a16726fa343f14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_cbb3305314b0b54cb2a16726fa343f14.jpg already downloaded
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_bf2260784cedb241d03bff507ba8fa5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_bf2260784cedb241d03bff507ba8fa5e.jpg already downloaded
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_745d443ddd2c35c486aa631b93d085bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_745d443ddd2c35c486aa631b93d085bb.jpg already downloaded
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_a43d10440f47de2f165631a12df30b78.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_a43d10440f47de2f165631a12df30b78.jpg already downloaded
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_901d33d3cac30813ea37b729c0715cf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_901d33d3cac30813ea37b729c0715cf5.jpg already downloaded
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_8d141eae2c28747e37c7ccf99818d42b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_8d141eae2c28747e37c7ccf99818d42b.jpg already downloaded
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_be803b2a565bac6b02f3c579eb6e5af7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_be803b2a565bac6b02f3c579eb6e5af7.jpg already downloaded
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_d48c7a7f6403b9cd32dfe377087cefd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_d48c7a7f6403b9cd32dfe377087cefd0.jpg already downloaded
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_19a278205bb73211d1887010259341ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_19a278205bb73211d1887010259341ef.jpg already downloaded
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F6e%252F006eb00b0dde59c59ab6ad8281fd4fa2%252Fpa%252FNA59815_6388c3b38f0a3b1b00f88551a3f4f25e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_6388c3b38f0a3b1b00f88551a3f4f25e.jpg already downloaded
2026-03-30 11:21:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6e7b39c8-5b10-5dff-b24c-68831f75e0f3, identifier: NA59815
2026-03-30 11:21:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6e7b39c8-5b10-5dff-b24c-68831f75e0f3 with identifier: NA59815
2026-03-30 11:21:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6e7b39c8-5b10-5dff-b24c-68831f75e0f3 with identifier: NA59815
2026-03-30 11:21:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6e7b39c8-5b10-5dff-b24c-68831f75e0f3 with identifier: NA59815 to the API
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NA59815>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:49:40Z',
 'fuel_type': 'diesel',
 'id': '6e7b39c8-5b10-5dff-b24c-68831f75e0f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA59815',
 'listing': 'auction',
 'location': 'ES, A Cañiza Pontevedra',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 133396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_cbb3305314b0b54cb2a16726fa343f14.jpg',
                'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_bf2260784cedb241d03bff507ba8fa5e.jpg',
                'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_745d443ddd2c35c486aa631b93d085bb.jpg',
                'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_a43d10440f47de2f165631a12df30b78.jpg',
                'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_901d33d3cac30813ea37b729c0715cf5.jpg',
                'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_8d141eae2c28747e37c7ccf99818d42b.jpg',
                'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_be803b2a565bac6b02f3c579eb6e5af7.jpg',
                'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_d48c7a7f6403b9cd32dfe377087cefd0.jpg',
                'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_19a278205bb73211d1887010259341ef.jpg',
                'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_6388c3b38f0a3b1b00f88551a3f4f25e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_cbb3305314b0b54cb2a16726fa343f14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_bf2260784cedb241d03bff507ba8fa5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_745d443ddd2c35c486aa631b93d085bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_a43d10440f47de2f165631a12df30b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_901d33d3cac30813ea37b729c0715cf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_8d141eae2c28747e37c7ccf99818d42b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_be803b2a565bac6b02f3c579eb6e5af7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_d48c7a7f6403b9cd32dfe377087cefd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_19a278205bb73211d1887010259341ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7b39c8-5b10-5dff-b24c-68831f75e0f3/6e7b39c8-5b10-5dff-b24c-68831f75e0f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/6e/006eb00b0dde59c59ab6ad8281fd4fa2/pa/NA59815_6388c3b38f0a3b1b00f88551a3f4f25e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-30 11:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA59815%27 HTTP/1.1" 200 None
2026-03-30 11:21:21 [auto1.es] INFO: Saving data for NA59815: {'created_time': 1774869681.697816, 'last_price_update_time': 1774869681.697828, 'auction_closing_time': 1774972180.0}
2026-03-30 11:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA59815') HTTP/1.1" 204 0
2026-03-30 11:21:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:43 [auto1.es] INFO: Channel: 24h | Page: 30 | totalHits: 2219 | hits on page: 40
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: WA73273
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: TP06770
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: JG96257
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG96257%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for JG96257: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: XX73025
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: KL57529
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: CH60945
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH60945%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for CH60945: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: UV28052
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: WK61099
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK61099%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for WK61099: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: ER43390
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER43390%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for ER43390: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: ZG91019
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: YA56979
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: MM94561
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM94561%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for MM94561: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: CP55474
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: EK02363
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: RR37429
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: FT14290
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: MV51278
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: TZ15382
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: CH35723
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH35723%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for CH35723: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: BK94618
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK94618%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for BK94618: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: XT80551
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT80551%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for XT80551: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: SL83785
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL83785%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for SL83785: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: RH48139
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: XU11405
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU11405%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for XU11405: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: VR07932
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: TZ59623
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: UZ58756
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ58756%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for UZ58756: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: DK97910
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: TY54994
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: KJ62845
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: UU93913
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: RD73419
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD73419%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for RD73419: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: ZE78921
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE78921%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for ZE78921: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: ZH97805
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: GB64088
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: EC92168
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC92168%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for EC92168: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: DU03691
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: FY67843
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY67843%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for FY67843: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: LA22899
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA22899%27 HTTP/1.1" 200 None
2026-03-30 11:21:43 [auto1.es] INFO: Scrape type for LA22899: 0
2026-03-30 11:21:43 [auto1.es] INFO: Found listing with ID: BK29060
2026-03-30 11:21:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:51 [auto1.es] INFO: Channel: 24h | Page: 31 | totalHits: 2220 | hits on page: 40
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: BK29060
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: FE11610
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE11610%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.es] INFO: Scrape type for FE11610: 0
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: MD24315
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: DF11976
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: HL11989
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL11989%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.es] INFO: Scrape type for HL11989: 0
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: EE18578
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: HV58793
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: AU82484
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU82484%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.es] INFO: Scrape type for AU82484: 0
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: CL32416
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL32416%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.es] INFO: Scrape type for CL32416: 0
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: JT03070
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT03070%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.es] INFO: Scrape type for JT03070: 0
2026-03-30 11:21:51 [auto1.es] INFO: Found listing with ID: NE16283
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE16283%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for NE16283: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: CZ44348
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: ZA37078
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: UE66949
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: UZ91236
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ91236%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for UZ91236: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: CU24817
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU24817%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for CU24817: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: RR40846
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: UG21171
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: GZ25501
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ25501%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for GZ25501: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: AS83743
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: LS55149
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS55149%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for LS55149: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: GT92698
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: PD21728
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: VD81677
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD81677%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for VD81677: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: YT10361
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: ZD67493
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD67493%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for ZD67493: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: XB61397
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: MX84470
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX84470%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for MX84470: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: FC07978
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC07978%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for FC07978: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: WW69130
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: YX82549
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX82549%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for YX82549: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: TX02408
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX02408%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for TX02408: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: MT58185
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT58185%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for MT58185: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: JP19484
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP19484%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for JP19484: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: BM81559
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM81559%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for BM81559: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: CK76032
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK76032%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for CK76032: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: WV75018
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: PG51774
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG51774%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for PG51774: 0
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: PA43540
2026-03-30 11:21:52 [auto1.es] INFO: Found listing with ID: CB03666
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB03666%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.es] INFO: Scrape type for CB03666: 0
2026-03-30 11:21:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:53 [auto1.es] INFO: Channel: 24h | Page: 32 | totalHits: 2221 | hits on page: 40
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: CB03666
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB03666%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for CB03666: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: ZJ67299
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: ZN02005
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: MD81888
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD81888%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for MD81888: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: ZW95177
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW95177%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for ZW95177: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: LC37713
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC37713%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for LC37713: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: BD22709
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: VB81501
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB81501%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for VB81501: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: ZZ62546
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ62546%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for ZZ62546: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: FA71297
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA71297%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for FA71297: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: UV08458
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: NL01395
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: WA88394
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: VR45740
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR45740%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for VR45740: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: EZ05662
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: UJ64573
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ64573%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for UJ64573: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: TT52004
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT52004%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for TT52004: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: YW59434
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW59434%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for YW59434: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: DW22650
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW22650%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for DW22650: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: NL32920
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL32920%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for NL32920: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: XF10257
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF10257%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for XF10257: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: YT02265
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT02265%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for YT02265: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: TG66753
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG66753%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for TG66753: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: TH38754
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH38754%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for TH38754: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: CM92438
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: BX60688
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: ER91055
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: ES48862
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: TV58646
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV58646%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for TV58646: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: PK58195
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: BC07750
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: TV36726
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: RU11910
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: KL17939
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: XH50909
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: XE30764
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE30764%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for XE30764: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: UZ86093
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: KE66826
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE66826%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [auto1.es] INFO: Scrape type for KE66826: 0
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: GT72542
2026-03-30 11:21:53 [auto1.es] INFO: Found listing with ID: TW93253
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW93253%27 HTTP/1.1" 200 None
2026-03-30 11:21:54 [auto1.es] INFO: Scrape type for TW93253: 0
2026-03-30 11:21:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:58 [auto1.es] INFO: Channel: 24h | Page: 33 | totalHits: 2221 | hits on page: 40
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: ZZ72823
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ72823%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for ZZ72823: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: ZE41555
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: SB32545
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB32545%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for SB32545: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: UG14230
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: US15459
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US15459%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for US15459: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: VC98401
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: VJ61689
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: MA92923
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA92923%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for MA92923: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: TZ36663
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ36663%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for TZ36663: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: RK72644
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK72644%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for RK72644: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: GT49964
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT49964%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for GT49964: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: XW07664
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: UR00464
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: FA05952
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA05952%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for FA05952: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: HA22815
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA22815%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for HA22815: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: KT28524
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT28524%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for KT28524: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: BZ29136
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: US76988
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US76988%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for US76988: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: ZA28450
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: XY35870
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY35870%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for XY35870: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: MB16167
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB16167%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for MB16167: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: SD86160
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: UT04175
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT04175%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for UT04175: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: KK78857
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK78857%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for KK78857: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: GP92404
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP92404%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for GP92404: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: NJ25414
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: MZ66022
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ66022%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for MZ66022: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: ZD85047
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: TV99660
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV99660%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for TV99660: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: LE09183
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE09183%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for LE09183: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: MK04112
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK04112%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for MK04112: 0
2026-03-30 11:21:58 [auto1.es] INFO: Found listing with ID: GF91510
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF91510%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.es] INFO: Scrape type for GF91510: 2
2026-03-30 11:21:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78022b4d-82b9-5a75-8956-3ccec8db8716 with identifier: GF91510
2026-03-30 11:21:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78022b4d-82b9-5a75-8956-3ccec8db8716 with scrape type 2
2026-03-30 11:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78022b4d-82b9-5a75-8956-3ccec8db8716 with scrape type 2
2026-03-30 11:21:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78022b4d-82b9-5a75-8956-3ccec8db8716, identifier: GF91510
2026-03-30 11:21:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78022b4d-82b9-5a75-8956-3ccec8db8716 with identifier: GF91510
2026-03-30 11:21:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78022b4d-82b9-5a75-8956-3ccec8db8716 with identifier: GF91510
2026-03-30 11:21:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 78022b4d-82b9-5a75-8956-3ccec8db8716 with identifier: GF91510 to the API
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:35Z',
 'fuel_type': 'petrol',
 'id': '78022b4d-82b9-5a75-8956-3ccec8db8716',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF91510',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 252523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-01',
 'seller_name': None,
 'title': 'Honda Civic 1.8 VTEC Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF91510%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.es] INFO: Saving data for GF91510: {'auction_closing_time': 1774885955.0, 'created_time': 1774598437.8398, 'last_price_update_time': 1774869719.468372}
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF91510') HTTP/1.1" 204 0
2026-03-30 11:21:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:59 [auto1.es] INFO: Found listing with ID: DH50359
2026-03-30 11:21:59 [auto1.es] INFO: Found listing with ID: CY33639
2026-03-30 11:21:59 [auto1.es] INFO: Found listing with ID: MV66149
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV66149%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.es] INFO: Scrape type for MV66149: 0
2026-03-30 11:21:59 [auto1.es] INFO: Found listing with ID: TH42321
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH42321%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.es] INFO: Scrape type for TH42321: 0
2026-03-30 11:21:59 [auto1.es] INFO: Found listing with ID: YN87603
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN87603%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.es] INFO: Scrape type for YN87603: 0
2026-03-30 11:21:59 [auto1.es] INFO: Found listing with ID: VY79156
2026-03-30 11:21:59 [auto1.es] INFO: Found listing with ID: ZD98631
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD98631%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.es] INFO: Scrape type for ZD98631: 0
2026-03-30 11:21:59 [auto1.es] INFO: Found listing with ID: WF38269
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF38269%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.es] INFO: Scrape type for WF38269: 0
2026-03-30 11:22:04 [scrapy.extensions.logstats] INFO: Crawled 194 pages (at 5 pages/min), scraped 227 items (at 2 items/min)
2026-03-30 11:22:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:16 [auto1.es] INFO: Channel: 24h | Page: 34 | totalHits: 2224 | hits on page: 40
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: VY79156
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: ZD98631
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD98631%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for ZD98631: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: WF38269
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF38269%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for WF38269: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: ZP63371
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: LN79000
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN79000%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for LN79000: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: AR66930
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR66930%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for AR66930: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: UY91237
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY91237%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for UY91237: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: NF50225
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: BW95892
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW95892%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for BW95892: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: WJ41546
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ41546%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for WJ41546: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: EV24986
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: AK39366
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: CV55647
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV55647%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for CV55647: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: MP42129
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: US62841
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62841%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for US62841: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: ZF52825
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF52825%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for ZF52825: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: ZT28887
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: RU33051
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: RE88096
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE88096%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for RE88096: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: AB11386
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: ZZ54358
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ54358%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for ZZ54358: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: MZ44217
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ44217%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for MZ44217: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: CE45579
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE45579%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for CE45579: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: NT36194
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: FB55193
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: MR81111
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: WS59204
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: NN13578
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN13578%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for NN13578: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: NB97215
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: JM88117
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM88117%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for JM88117: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: BB64860
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: MN42055
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN42055%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for MN42055: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: UM01301
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: DA46223
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA46223%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for DA46223: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: EK86006
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: JB16763
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB16763%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for JB16763: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: XT42288
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT42288%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for XT42288: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: VM06943
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: BB29813
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB29813%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for BB29813: 0
2026-03-30 11:22:16 [auto1.es] INFO: Found listing with ID: EE09579
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE09579%27 HTTP/1.1" 200 None
2026-03-30 11:22:16 [auto1.es] INFO: Scrape type for EE09579: 0
2026-03-30 11:22:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:37 [auto1.es] INFO: Channel: 24h | Page: 35 | totalHits: 2225 | hits on page: 40
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: EE09579
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE09579%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for EE09579: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: YU03196
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: HU12913
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU12913%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for HU12913: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: WZ44927
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: UG25415
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG25415%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for UG25415: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: LJ64414
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ64414%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for LJ64414: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: DV40298
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV40298%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for DV40298: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: BV69737
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV69737%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for BV69737: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: FJ09985
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ09985%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for FJ09985: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: XT49013
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: BM13295
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM13295%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for BM13295: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: JF42327
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF42327%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for JF42327: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: NT66217
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: UE32558
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: FZ71320
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: SR43030
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR43030%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for SR43030: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: VP11478
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: TJ92656
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: EB93661
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB93661%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for EB93661: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: AE79363
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE79363%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for AE79363: 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: AR16993
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: RP83421
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: EB96855
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: SU20973
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: JM72010
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM72010%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for JM72010: 2
2026-03-30 11:22:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dbb315c-d7fe-548a-b668-25e3a8cbe196 with identifier: JM72010
2026-03-30 11:22:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dbb315c-d7fe-548a-b668-25e3a8cbe196 with scrape type 2
2026-03-30 11:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dbb315c-d7fe-548a-b668-25e3a8cbe196 with scrape type 2
2026-03-30 11:22:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0dbb315c-d7fe-548a-b668-25e3a8cbe196, identifier: JM72010
2026-03-30 11:22:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0dbb315c-d7fe-548a-b668-25e3a8cbe196 with identifier: JM72010
2026-03-30 11:22:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0dbb315c-d7fe-548a-b668-25e3a8cbe196 with identifier: JM72010
2026-03-30 11:22:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0dbb315c-d7fe-548a-b668-25e3a8cbe196 with identifier: JM72010 to the API
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:19Z',
 'fuel_type': 'diesel',
 'id': '0dbb315c-d7fe-548a-b668-25e3a8cbe196',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM72010',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 149625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM72010%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Saving data for JM72010: {'auction_closing_time': 1774885279.0, 'created_time': 1774598439.660156, 'last_price_update_time': 1774869758.199608}
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JM72010') HTTP/1.1" 204 0
2026-03-30 11:22:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: AZ15880
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ15880%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for AZ15880: 0
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: UD80780
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD80780%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for UD80780: 0
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: KK58093
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK58093%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for KK58093: 0
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: HA25095
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: DW27035
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW27035%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for DW27035: 0
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: ZG18454
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: XV58633
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: FJ32217
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: LB05915
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB05915%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for LB05915: 0
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: JJ54433
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: PW99692
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: AW04396
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW04396%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for AW04396: 0
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: RT81282
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: SN13846
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN13846%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for SN13846: 0
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: SE78782
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE78782%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for SE78782: 0
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:40 [auto1.es] INFO: Channel: 24h | Page: 36 | totalHits: 2225 | hits on page: 40
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: YG58121
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG58121%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for YG58121: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: YX61230
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX61230%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for YX61230: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: ZJ79467
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: DX86055
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX86055%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for DX86055: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: RM79142
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM79142%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for RM79142: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: TC70621
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC70621%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for TC70621: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: MC49666
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC49666%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for MC49666: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: HZ02297
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: AG74382
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: HU25614
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: KE44681
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE44681%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for KE44681: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: GS59468
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: AV97332
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV97332%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for AV97332: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: EH44076
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: HJ75824
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: PE24027
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE24027%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for PE24027: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: HB55085
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: ZL28914
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: VE50785
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE50785%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for VE50785: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: SH67409
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH67409%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.es] INFO: Scrape type for SH67409: 0
2026-03-30 11:22:40 [auto1.es] INFO: Found listing with ID: PJ00608
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ00608%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.es] INFO: Scrape type for PJ00608: 0
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: LX82632
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX82632%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.es] INFO: Scrape type for LX82632: 2
2026-03-30 11:22:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f012e360-ccbe-5db8-8872-862113d720b6 with identifier: LX82632
2026-03-30 11:22:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f012e360-ccbe-5db8-8872-862113d720b6 with scrape type 2
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f012e360-ccbe-5db8-8872-862113d720b6 with scrape type 2
2026-03-30 11:22:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f012e360-ccbe-5db8-8872-862113d720b6, identifier: LX82632
2026-03-30 11:22:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f012e360-ccbe-5db8-8872-862113d720b6 with identifier: LX82632
2026-03-30 11:22:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f012e360-ccbe-5db8-8872-862113d720b6 with identifier: LX82632
2026-03-30 11:22:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f012e360-ccbe-5db8-8872-862113d720b6 with identifier: LX82632 to the API
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:15:56Z',
 'fuel_type': 'petrol',
 'id': 'f012e360-ccbe-5db8-8872-862113d720b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX82632',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 94549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-15',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Lounge Plus',
 'transmission': 'manual',
 'trim': 'Lounge Plus',
 'year': 2016}
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX82632%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.es] INFO: Saving data for LX82632: {'auction_closing_time': 1774883756.0, 'created_time': 1774598438.815777, 'last_price_update_time': 1774869761.593047}
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LX82632') HTTP/1.1" 204 0
2026-03-30 11:22:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: RY19109
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY19109%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.es] INFO: Scrape type for RY19109: 0
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: RK31632
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: RH35807
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: ZA80784
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: AP01935
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP01935%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.es] INFO: Scrape type for AP01935: 0
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: HA98182
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: NG74473
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG74473%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.es] INFO: Scrape type for NG74473: 0
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: HB38669
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB38669%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.es] INFO: Scrape type for HB38669: 0
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: WH24419
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: GF99536
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: JX70017
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX70017%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.es] INFO: Scrape type for JX70017: 0
2026-03-30 11:22:41 [auto1.es] INFO: Found listing with ID: PL21143
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL21143%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.es] INFO: Scrape type for PL21143: 2
2026-03-30 11:22:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de40c33-cf01-5f99-be24-7020332bac33 with identifier: PL21143
2026-03-30 11:22:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de40c33-cf01-5f99-be24-7020332bac33 with scrape type 2
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de40c33-cf01-5f99-be24-7020332bac33 with scrape type 2
2026-03-30 11:22:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9de40c33-cf01-5f99-be24-7020332bac33, identifier: PL21143
2026-03-30 11:22:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9de40c33-cf01-5f99-be24-7020332bac33 with identifier: PL21143
2026-03-30 11:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9de40c33-cf01-5f99-be24-7020332bac33 with identifier: PL21143
2026-03-30 11:22:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9de40c33-cf01-5f99-be24-7020332bac33 with identifier: PL21143 to the API
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:33:59Z',
 'fuel_type': 'diesel',
 'id': '9de40c33-cf01-5f99-be24-7020332bac33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL21143',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 270896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-24',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Sportline',
 'transmission': 'automatic',
 'trim': 'Sportline',
 'year': 2007}
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL21143%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.es] INFO: Saving data for PL21143: {'auction_closing_time': 1774884839.0, 'created_time': 1773345670.772034, 'last_price_update_time': 1774869762.390553}
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PL21143') HTTP/1.1" 204 0
2026-03-30 11:22:42 [auto1.es] INFO: Found listing with ID: GZ61403
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ61403%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.es] INFO: Scrape type for GZ61403: 0
2026-03-30 11:22:42 [auto1.es] INFO: Found listing with ID: PD17011
2026-03-30 11:22:42 [auto1.es] INFO: Found listing with ID: CW88498
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW88498%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.es] INFO: Scrape type for CW88498: 0
2026-03-30 11:22:42 [auto1.es] INFO: Found listing with ID: RT90695
2026-03-30 11:22:42 [auto1.es] INFO: Found listing with ID: BF22404
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF22404%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.es] INFO: Scrape type for BF22404: 0
2026-03-30 11:22:42 [auto1.es] INFO: Found listing with ID: BL42593
2026-03-30 11:23:04 [scrapy.extensions.logstats] INFO: Crawled 197 pages (at 3 pages/min), scraped 230 items (at 3 items/min)
2026-03-30 11:23:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:18 [auto1.es] INFO: Channel: 24h | Page: 37 | totalHits: 2226 | hits on page: 40
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: BL42593
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: HG47154
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG47154%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for HG47154: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: SM50481
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: KG64326
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: HF28057
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF28057%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for HF28057: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: AD15625
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD15625%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for AD15625: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: DV59548
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV59548%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for DV59548: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: XC28006
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC28006%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for XC28006: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: GT68357
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT68357%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for GT68357: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: MZ54464
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: NM44751
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: ZP51440
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: MM77073
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: AK44201
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK44201%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for AK44201: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: GT62572
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: XC60196
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: XT74556
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT74556%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for XT74556: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: YM46867
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: WH83968
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH83968%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for WH83968: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: KS63423
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: KP83247
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: ET28977
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: GM08675
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: PP39110
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: XS51461
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: YG24338
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: ZY52551
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: SK48295
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: RJ73355
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ73355%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for RJ73355: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: BG55573
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: FP05442
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP05442%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for FP05442: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: FM79545
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: TC59600
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: PD85443
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: KB02477
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB02477%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for KB02477: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: GS63441
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS63441%27 HTTP/1.1" 200 None
2026-03-30 11:23:18 [auto1.es] INFO: Scrape type for GS63441: 0
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: WY33726
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: UN48469
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: TJ35606
2026-03-30 11:23:18 [auto1.es] INFO: Found listing with ID: PD75300
2026-03-30 11:23:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:27 [auto1.es] INFO: Channel: 24h | Page: 38 | totalHits: 2226 | hits on page: 40
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: PN16892
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN16892%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for PN16892: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: XV71103
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: PS31871
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS31871%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for PS31871: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: DG38450
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: RP86418
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP86418%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for RP86418: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: MH48496
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH48496%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for MH48496: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: MM73463
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM73463%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for MM73463: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: UF76170
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: LR89235
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: ES15520
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES15520%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for ES15520: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: HS16028
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: HT23405
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: FH47587
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: PJ49539
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: GB32148
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: NM59518
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: JJ75829
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: LS97770
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: VK38327
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK38327%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for VK38327: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: XK60422
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK60422%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for XK60422: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: GW16894
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: LP80713
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP80713%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for LP80713: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: FT33215
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: FY66249
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: UD26451
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD26451%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for UD26451: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: LF19420
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: LK07555
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: MA33029
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA33029%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for MA33029: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: LX51563
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX51563%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for LX51563: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: YH79403
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH79403%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for YH79403: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: MA08789
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: LG55317
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: JW67554
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW67554%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for JW67554: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: ZS20717
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS20717%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for ZS20717: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: HH46764
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: TA73897
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA73897%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for TA73897: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: UD21856
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: JY07683
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY07683%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for JY07683: 0
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: BV18028
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: CV84892
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV84892%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for CV84892: 0
2026-03-30 11:23:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:45 [auto1.es] INFO: Channel: 24h | Page: 39 | totalHits: 2227 | hits on page: 40
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: CV84892
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV84892%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for CV84892: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: LG59471
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG59471%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for LG59471: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: SU85789
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: HE05235
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: XH86580
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH86580%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for XH86580: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: PP21573
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP21573%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for PP21573: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: ZE71239
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: FF26714
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: NC38723
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: LG94479
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: DZ42678
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: ZS73380
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: DB92602
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB92602%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for DB92602: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: AL10193
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: JH13002
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: NZ88130
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: CT66486
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: RF22633
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF22633%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for RF22633: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: DD15597
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD15597%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for DD15597: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: AS08117
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: HE42254
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: RB01014
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB01014%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for RB01014: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: RK45787
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK45787%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for RK45787: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: DL05579
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: RR55958
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: DR60635
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR60635%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for DR60635: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: XH33697
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH33697%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for XH33697: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: CH33556
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH33556%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for CH33556: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: ZE13912
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE13912%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for ZE13912: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: MJ15003
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: EN16009
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN16009%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for EN16009: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: LN78930
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN78930%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for LN78930: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: FL07647
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: VU96042
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU96042%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for VU96042: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: SB36142
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: TN84578
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN84578%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for TN84578: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: WH54771
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: BC37690
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: AK05110
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK05110%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for AK05110: 0
2026-03-30 11:23:45 [auto1.es] INFO: Found listing with ID: CC73171
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC73171%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [auto1.es] INFO: Scrape type for CC73171: 0
2026-03-30 11:23:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:53 [auto1.es] INFO: Channel: 24h | Page: 40 | totalHits: 2227 | hits on page: 40
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: HV86151
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV86151%27 HTTP/1.1" 200 None
2026-03-30 11:23:53 [auto1.es] INFO: Scrape type for HV86151: 0
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: WH79460
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH79460%27 HTTP/1.1" 200 None
2026-03-30 11:23:53 [auto1.es] INFO: Scrape type for WH79460: 0
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: AG66489
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: VM02811
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: VJ40506
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: BX46671
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: CW49447
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW49447%27 HTTP/1.1" 200 None
2026-03-30 11:23:53 [auto1.es] INFO: Scrape type for CW49447: 0
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: FA05527
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA05527%27 HTTP/1.1" 200 None
2026-03-30 11:23:53 [auto1.es] INFO: Scrape type for FA05527: 0
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: MG44284
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: VV22800
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV22800%27 HTTP/1.1" 200 None
2026-03-30 11:23:53 [auto1.es] INFO: Scrape type for VV22800: 0
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: JC46060
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC46060%27 HTTP/1.1" 200 None
2026-03-30 11:23:53 [auto1.es] INFO: Scrape type for JC46060: 0
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: SM77284
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM77284%27 HTTP/1.1" 200 None
2026-03-30 11:23:53 [auto1.es] INFO: Scrape type for SM77284: 0
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: AG32524
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG32524%27 HTTP/1.1" 200 None
2026-03-30 11:23:53 [auto1.es] INFO: Scrape type for AG32524: 0
2026-03-30 11:23:53 [auto1.es] INFO: Found listing with ID: PH11049
2026-03-30 11:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH11049%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for PH11049: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: YF13100
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: NK92990
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: XY25635
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: WP66264
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP66264%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for WP66264: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: LG93188
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG93188%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for LG93188: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: UR64839
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR64839%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for UR64839: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: BT14659
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT14659%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for BT14659: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: NN09509
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN09509%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for NN09509: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: LL30707
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL30707%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for LL30707: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: XY10294
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY10294%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for XY10294: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: FD66693
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD66693%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for FD66693: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: DC98818
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC98818%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for DC98818: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: YG93174
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG93174%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for YG93174: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: ZH85985
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH85985%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for ZH85985: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: UA50937
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA50937%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for UA50937: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: LC97484
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC97484%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for LC97484: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: EE07728
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: BL83097
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: ZJ52163
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ52163%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for ZJ52163: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: CV75612
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: TV15408
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV15408%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for TV15408: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: CH38483
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: JP11260
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: NK34270
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK34270%27 HTTP/1.1" 200 None
2026-03-30 11:23:54 [auto1.es] INFO: Scrape type for NK34270: 0
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: TN34966
2026-03-30 11:23:54 [auto1.es] INFO: Found listing with ID: WW97634
2026-03-30 11:23:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:04 [scrapy.extensions.logstats] INFO: Crawled 201 pages (at 4 pages/min), scraped 230 items (at 0 items/min)
2026-03-30 11:24:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:27 [auto1.es] INFO: Channel: 24h | Page: 41 | totalHits: 2232 | hits on page: 40
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: CH38483
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: JP11260
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: NK34270
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK34270%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for NK34270: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: TN34966
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: WW97634
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: CZ73203
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ73203%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for CZ73203: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: LV49477
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49477%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for LV49477: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: KX05892
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX05892%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for KX05892: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: JZ86442
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: TV57362
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV57362%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for TV57362: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: PH10774
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: CZ94183
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: NM83304
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM83304%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for NM83304: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: YC76181
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: GY52926
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY52926%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for GY52926: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: VF82701
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: LR10742
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: RV28339
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: UV92160
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: YL57759
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL57759%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for YL57759: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: SJ56624
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ56624%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for SJ56624: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: VZ06267
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: ZT56570
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT56570%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for ZT56570: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: NW09077
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: AB11281
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: YY21107
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: YT85498
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: VY69585
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: XU33886
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU33886%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for XU33886: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: VG77720
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: MA45744
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: CD12764
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD12764%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for CD12764: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: RL13967
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL13967%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for RL13967: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: GU02949
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU02949%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for GU02949: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: FS30541
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS30541%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for FS30541: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: SG84832
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG84832%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for SG84832: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: WA94101
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: VL72913
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: RT56400
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT56400%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for RT56400: 0
2026-03-30 11:24:27 [auto1.es] INFO: Found listing with ID: DD02198
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD02198%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.es] INFO: Scrape type for DD02198: 0
2026-03-30 11:24:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:29 [auto1.es] INFO: Channel: 24h | Page: 42 | totalHits: 2232 | hits on page: 40
2026-03-30 11:24:29 [auto1.es] INFO: Found listing with ID: EN73965
2026-03-30 11:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN73965%27 HTTP/1.1" 200 None
2026-03-30 11:24:29 [auto1.es] INFO: Scrape type for EN73965: 0
2026-03-30 11:24:29 [auto1.es] INFO: Found listing with ID: NJ18297
2026-03-30 11:24:29 [auto1.es] INFO: Found listing with ID: AV04114
2026-03-30 11:24:29 [auto1.es] INFO: Found listing with ID: WC85393
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC85393%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for WC85393: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: CH09218
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: CE26517
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE26517%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for CE26517: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: YD82310
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: SZ71076
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: GT34308
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: GG82225
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: CF71670
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF71670%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for CF71670: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: GY32674
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY32674%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for GY32674: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: ML55356
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: EB66984
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: ES45064
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: YM72054
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: KX99272
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: UU25578
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU25578%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for UU25578: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: WC57455
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: DT02195
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT02195%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for DT02195: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: RH85625
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: HN11800
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: FU14405
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU14405%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for FU14405: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: FG12610
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG12610%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for FG12610: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: PZ51501
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ51501%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for PZ51501: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: PN60622
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: FM31640
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM31640%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for FM31640: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: SP11103
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: MD28950
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD28950%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for MD28950: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: KL48857
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL48857%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for KL48857: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: XR91515
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR91515%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for XR91515: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: ZD58886
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD58886%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for ZD58886: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: MA84687
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: GN52396
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: RW68168
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: SN05044
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: XP48517
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: DR19910
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR19910%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for DR19910: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: VW52839
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW52839%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.es] INFO: Scrape type for VW52839: 0
2026-03-30 11:24:30 [auto1.es] INFO: Found listing with ID: RJ81343
2026-03-30 11:24:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:32 [auto1.es] INFO: Channel: 24h | Page: 43 | totalHits: 2232 | hits on page: 40
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: KU93995
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: ZT16054
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: CD34626
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: UT51740
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT51740%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for UT51740: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: WN15214
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: YY16835
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: ZF10967
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: EV20244
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV20244%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for EV20244: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: SB84191
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: WM47601
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: AE81863
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE81863%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for AE81863: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: PL43950
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: LK68537
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: EH39769
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH39769%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for EH39769: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: SH75312
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH75312%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for SH75312: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: XD15291
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: VT03580
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT03580%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for VT03580: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: DB28446
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: LU54456
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: UY97217
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: PK04858
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK04858%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for PK04858: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: UM71516
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM71516%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for UM71516: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: UH45112
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: HF92394
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: PX22333
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX22333%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for PX22333: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: SG11403
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG11403%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for SG11403: 0
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: YF90515
2026-03-30 11:24:32 [auto1.es] INFO: Found listing with ID: DH00541
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH00541%27 HTTP/1.1" 200 None
2026-03-30 11:24:32 [auto1.es] INFO: Scrape type for DH00541: 2
2026-03-30 11:24:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61c2f840-23c4-5308-9850-437f37f94e03 with identifier: DH00541
2026-03-30 11:24:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61c2f840-23c4-5308-9850-437f37f94e03 with scrape type 2
2026-03-30 11:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61c2f840-23c4-5308-9850-437f37f94e03 with scrape type 2
2026-03-30 11:24:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 61c2f840-23c4-5308-9850-437f37f94e03, identifier: DH00541
2026-03-30 11:24:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 61c2f840-23c4-5308-9850-437f37f94e03 with identifier: DH00541
2026-03-30 11:24:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 61c2f840-23c4-5308-9850-437f37f94e03 with identifier: DH00541
2026-03-30 11:24:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 61c2f840-23c4-5308-9850-437f37f94e03 with identifier: DH00541 to the API
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:51:49Z',
 'fuel_type': 'diesel',
 'id': '61c2f840-23c4-5308-9850-437f37f94e03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH00541',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 270497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-29',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH00541%27 HTTP/1.1" 200 None
2026-03-30 11:24:33 [auto1.es] INFO: Saving data for DH00541: {'auction_closing_time': 1774885909.0, 'created_time': 1774598440.419699, 'last_price_update_time': 1774869873.288725}
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH00541') HTTP/1.1" 204 0
2026-03-30 11:24:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: YS60567
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS60567%27 HTTP/1.1" 200 None
2026-03-30 11:24:33 [auto1.es] INFO: Scrape type for YS60567: 0
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: HL39596
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: LK18237
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK18237%27 HTTP/1.1" 200 None
2026-03-30 11:24:33 [auto1.es] INFO: Scrape type for LK18237: 0
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: LC05327
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC05327%27 HTTP/1.1" 200 None
2026-03-30 11:24:33 [auto1.es] INFO: Scrape type for LC05327: 0
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: WA10977
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA10977%27 HTTP/1.1" 200 None
2026-03-30 11:24:33 [auto1.es] INFO: Scrape type for WA10977: 0
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: PS29729
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: WC91216
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: RV14480
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV14480%27 HTTP/1.1" 200 None
2026-03-30 11:24:33 [auto1.es] INFO: Scrape type for RV14480: 0
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: NS96167
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: MW68540
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW68540%27 HTTP/1.1" 200 None
2026-03-30 11:24:33 [auto1.es] INFO: Scrape type for MW68540: 0
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: MN90156
2026-03-30 11:24:33 [auto1.es] INFO: Found listing with ID: LW73612
2026-03-30 11:24:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:45 [auto1.es] INFO: Channel: 24h | Page: 44 | totalHits: 2232 | hits on page: 40
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: SK17439
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: PD96380
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD96380%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for PD96380: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: MU04629
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: HT85667
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT85667%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for HT85667: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: GY39157
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: ZZ21581
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: UR06074
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: CB32241
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: XR92407
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: UD00521
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD00521%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for UD00521: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: GT44883
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT44883%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for GT44883: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: NA66808
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: JW04171
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: YA86748
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: ZC78414
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC78414%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for ZC78414: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: RJ55423
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ55423%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for RJ55423: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: HA27882
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA27882%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for HA27882: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: SK01159
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: CE82736
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE82736%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for CE82736: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: CP72287
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP72287%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for CP72287: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: SU07288
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: ZZ49032
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ49032%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for ZZ49032: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: WJ83814
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: BJ36748
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: YP76490
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: RS45242
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS45242%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for RS45242: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: AB84528
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB84528%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for AB84528: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: PS20422
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS20422%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for PS20422: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: ZR59289
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR59289%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for ZR59289: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: XV33818
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV33818%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for XV33818: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: EN12947
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: KK99044
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK99044%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for KK99044: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: VL09919
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL09919%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for VL09919: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: SX15472
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX15472%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for SX15472: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: DG13081
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: FT05886
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT05886%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for FT05886: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: EU03494
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: ZC21665
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC21665%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for ZC21665: 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: MF02343
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: HP01859
2026-03-30 11:24:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:04 [scrapy.extensions.logstats] INFO: Crawled 205 pages (at 4 pages/min), scraped 231 items (at 1 items/min)
2026-03-30 11:25:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:26:04 [scrapy.extensions.logstats] INFO: Crawled 205 pages (at 0 pages/min), scraped 231 items (at 0 items/min)
2026-03-30 11:26:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:26:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.500(s), this was the 1st time calling it.
2026-03-30 11:26:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.317913497124215 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:26:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:27:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:01 [auto1.es] INFO: Channel: 24h | Page: 45 | totalHits: 2236 | hits on page: 40
2026-03-30 11:27:01 [auto1.es] INFO: Found listing with ID: ZC21665
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC21665%27 HTTP/1.1" 200 None
2026-03-30 11:27:01 [auto1.es] INFO: Scrape type for ZC21665: 0
2026-03-30 11:27:01 [auto1.es] INFO: Found listing with ID: MF02343
2026-03-30 11:27:01 [auto1.es] INFO: Found listing with ID: HP01859
2026-03-30 11:27:01 [auto1.es] INFO: Found listing with ID: VL50797
2026-03-30 11:27:01 [auto1.es] INFO: Found listing with ID: BN03285
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-30 11:27:01 [auto1.es] INFO: Scrape type for BN03285: 1
2026-03-30 11:27:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:01 [auto1.es] INFO: Found listing with ID: WZ30869
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ30869%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for WZ30869: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: ZM69944
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: YB94347
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: RN76428
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: LD17478
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: VG01013
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: FD79630
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: WL49874
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL49874%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for WL49874: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: WX54724
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX54724%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for WX54724: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: RX23320
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX23320%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for RX23320: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: XN30812
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN30812%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for XN30812: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: FK50437
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK50437%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for FK50437: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: CJ73946
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ73946%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for CJ73946: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: KS53137
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS53137%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for KS53137: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: BR63324
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: TF28365
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF28365%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for TF28365: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: KD08887
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD08887%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for KD08887: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: PF82044
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: LU79245
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: VT35195
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: EH02657
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH02657%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for EH02657: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: LB45570
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: UV89988
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: JC23738
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: UB42787
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB42787%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for UB42787: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: YU77194
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: DD46195
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD46195%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for DD46195: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: CZ41335
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: BS14602
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: CW02489
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: YL07915
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: LY43971
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY43971%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for LY43971: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: ML86623
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: CL39322
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL39322%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for CL39322: 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: JC37021
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC37021%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for JC37021: 0
2026-03-30 11:27:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:04 [scrapy.extensions.logstats] INFO: Crawled 206 pages (at 1 pages/min), scraped 231 items (at 0 items/min)
2026-03-30 11:27:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:27:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:07 [auto1.es] INFO: Channel: 24h | Page: 46 | totalHits: 2236 | hits on page: 40
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: UT20809
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT20809%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for UT20809: 2
2026-03-30 11:27:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b6e26c-1684-5214-9378-f263618a37ea with identifier: UT20809
2026-03-30 11:27:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b6e26c-1684-5214-9378-f263618a37ea with scrape type 2
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b6e26c-1684-5214-9378-f263618a37ea with scrape type 2
2026-03-30 11:27:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 21b6e26c-1684-5214-9378-f263618a37ea, identifier: UT20809
2026-03-30 11:27:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 21b6e26c-1684-5214-9378-f263618a37ea with identifier: UT20809
2026-03-30 11:27:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 21b6e26c-1684-5214-9378-f263618a37ea with identifier: UT20809
2026-03-30 11:27:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 21b6e26c-1684-5214-9378-f263618a37ea with identifier: UT20809 to the API
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:30:18Z',
 'fuel_type': 'diesel',
 'id': '21b6e26c-1684-5214-9378-f263618a37ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT20809',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 152941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Trend +',
 'transmission': 'manual',
 'trim': 'Trend +',
 'year': 2015}
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT20809%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Saving data for UT20809: {'auction_closing_time': 1774884618.0, 'created_time': 1773865110.585101, 'last_price_update_time': 1774870027.689713}
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT20809') HTTP/1.1" 204 0
2026-03-30 11:27:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: MX17134
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: TS75802
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS75802%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for TS75802: 0
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: LK62452
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: YM80761
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM80761%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for YM80761: 0
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: UZ32916
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: VL93613
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL93613%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for VL93613: 0
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: YU55670
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU55670%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for YU55670: 0
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: YS21780
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: PC51622
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: RT35335
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT35335%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for RT35335: 0
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: TU21075
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: PS45222
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: AP64708
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: YY12745
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: MW15131
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: TF48403
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF48403%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for TF48403: 0
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: XL12491
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: RB88414
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB88414%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for RB88414: 0
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: XL66794
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL66794%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for XL66794: 0
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: WE21693
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE21693%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for WE21693: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: FG54373
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG54373%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for FG54373: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: XS23007
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS23007%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for XS23007: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: UA81124
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA81124%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for UA81124: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: JC49855
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: GT09442
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT09442%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for GT09442: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: SN05978
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN05978%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for SN05978: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: KP85608
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: JH04975
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH04975%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for JH04975: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: EN74570
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN74570%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for EN74570: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: XA71436
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA71436%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for XA71436: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: BF21105
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF21105%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for BF21105: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: FN32638
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: PP85710
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: GJ06814
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: UF43058
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF43058%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for UF43058: 0
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: WC72839
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: XZ49849
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: TU32370
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: YW58225
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW58225%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for YW58225: 0
2026-03-30 11:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN03285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN03285> (referer: https://www.auto1.com/v1/car-details-view/BN03285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99bff1b3-6844-5928-8474-43fdcb0ec786 with identifier: BN03285
2026-03-30 11:27:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99bff1b3-6844-5928-8474-43fdcb0ec786 with scrape type 1
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 99bff1b3-6844-5928-8474-43fdcb0ec786
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_837a127a5e8ab1a523441a468aae032f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_837a127a5e8ab1a523441a468aae032f.jpg not downloaded yet
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_2e803502b4301190ca1b6f9dca7eab0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_2e803502b4301190ca1b6f9dca7eab0c.jpg not downloaded yet
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_93aaf792226fcf66c323a32fd9db1707.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_93aaf792226fcf66c323a32fd9db1707.jpg not downloaded yet
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_08104f9708ba01c47bfbbaf4da2c6732.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_08104f9708ba01c47bfbbaf4da2c6732.jpg not downloaded yet
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_02c4b51ebdfff2025f013ee5aac059f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_02c4b51ebdfff2025f013ee5aac059f6.jpg not downloaded yet
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_9cfbdd529f69522176c460cf1adc859d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_9cfbdd529f69522176c460cf1adc859d.jpg not downloaded yet
2026-03-30 11:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_837a127a5e8ab1a523441a468aae032f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_08104f9708ba01c47bfbbaf4da2c6732.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb64256d0>
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_837a127a5e8ab1a523441a468aae032f.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_837a127a5e8ab1a523441a468aae032f.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99bff1b3-6844-5928-8474-43fdcb0ec786
2026-03-30 11:27:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_93aaf792226fcf66c323a32fd9db1707.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_02c4b51ebdfff2025f013ee5aac059f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6463590>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_08104f9708ba01c47bfbbaf4da2c6732.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_08104f9708ba01c47bfbbaf4da2c6732.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99bff1b3-6844-5928-8474-43fdcb0ec786
2026-03-30 11:27:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_9cfbdd529f69522176c460cf1adc859d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_2e803502b4301190ca1b6f9dca7eab0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6427b10>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_93aaf792226fcf66c323a32fd9db1707.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_93aaf792226fcf66c323a32fd9db1707.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99bff1b3-6844-5928-8474-43fdcb0ec786
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66a7950>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_02c4b51ebdfff2025f013ee5aac059f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_02c4b51ebdfff2025f013ee5aac059f6.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99bff1b3-6844-5928-8474-43fdcb0ec786
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb6f1bf90>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_9cfbdd529f69522176c460cf1adc859d.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_9cfbdd529f69522176c460cf1adc859d.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99bff1b3-6844-5928-8474-43fdcb0ec786
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8cb66a6fd0>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbf%252F2cbfab09314770ea452dffd2df11ecae%252Fpa%252FBN03285_2e803502b4301190ca1b6f9dca7eab0c.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_2e803502b4301190ca1b6f9dca7eab0c.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99bff1b3-6844-5928-8474-43fdcb0ec786
2026-03-30 11:27:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99bff1b3-6844-5928-8474-43fdcb0ec786, skipping ID generation
2026-03-30 11:27:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99bff1b3-6844-5928-8474-43fdcb0ec786 with scrape type 1
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99bff1b3-6844-5928-8474-43fdcb0ec786 sending to next pipeline
2026-03-30 11:27:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 99bff1b3-6844-5928-8474-43fdcb0ec786, identifier: BN03285
2026-03-30 11:27:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 99bff1b3-6844-5928-8474-43fdcb0ec786 with identifier: BN03285
2026-03-30 11:27:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 99bff1b3-6844-5928-8474-43fdcb0ec786 with identifier: BN03285
2026-03-30 11:27:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 99bff1b3-6844-5928-8474-43fdcb0ec786 with identifier: BN03285 to the API
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_2e803502b4301190ca1b6f9dca7eab0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:08:50Z',
 'fuel_type': 'petrol',
 'id': '99bff1b3-6844-5928-8474-43fdcb0ec786',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN03285',
 'listing': 'auction',
 'location': 'Logroño',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 142434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_837a127a5e8ab1a523441a468aae032f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_2e803502b4301190ca1b6f9dca7eab0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_93aaf792226fcf66c323a32fd9db1707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_08104f9708ba01c47bfbbaf4da2c6732.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_02c4b51ebdfff2025f013ee5aac059f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99bff1b3-6844-5928-8474-43fdcb0ec786/99bff1b3-6844-5928-8474-43fdcb0ec786_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bf/2cbfab09314770ea452dffd2df11ecae/pa/BN03285_9cfbdd529f69522176c460cf1adc859d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S60 2.4 T AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2002}
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-30 11:27:12 [auto1.es] INFO: Saving data for BN03285: {'created_time': 1774870032.822198, 'last_price_update_time': 1774870032.82221, 'auction_closing_time': 1774883330.0}
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BN03285') HTTP/1.1" 204 0
2026-03-30 11:28:04 [scrapy.extensions.logstats] INFO: Crawled 209 pages (at 3 pages/min), scraped 233 items (at 2 items/min)
2026-03-30 11:28:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:28:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:14 [auto1.es] INFO: Channel: 24h | Page: 47 | totalHits: 2238 | hits on page: 40
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: TU32370
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: YW58225
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW58225%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for YW58225: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: WH26152
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH26152%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for WH26152: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: GJ16527
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ16527%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for GJ16527: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: AN25119
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN25119%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for AN25119: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: EA52375
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA52375%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for EA52375: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: PD86662
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: JK64156
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: EW34917
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW34917%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for EW34917: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: XN31464
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: DF08485
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF08485%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for DF08485: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: HF43561
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: ZE85496
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: DU61809
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: KW07393
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: HC67204
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC67204%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for HC67204: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: AP77113
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: YF73149
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: BY74928
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: WD34727
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD34727%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for WD34727: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: XS50380
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: XA81448
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: XW29028
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW29028%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for XW29028: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: NJ73279
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: BR73846
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: LA48157
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA48157%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for LA48157: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: UU20141
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: TR96675
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR96675%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for TR96675: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: VB99654
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB99654%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for VB99654: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: PK37230
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK37230%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for PK37230: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: DR08098
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: AJ61664
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ61664%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for AJ61664: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: FR40817
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: WC06824
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: DL11284
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL11284%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for DL11284: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: SK07271
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: XH48089
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: VY31603
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: ZL78219
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL78219%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for ZL78219: 0
2026-03-30 11:28:14 [auto1.es] INFO: Found listing with ID: EN05559
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN05559%27 HTTP/1.1" 200 None
2026-03-30 11:28:14 [auto1.es] INFO: Scrape type for EN05559: 0
2026-03-30 11:28:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:23 [auto1.es] INFO: Channel: 24h | Page: 48 | totalHits: 2238 | hits on page: 40
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: KV41270
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV41270%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for KV41270: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: TV36544
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: NY16020
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: ZZ18199
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: SL87514
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL87514%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for SL87514: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: TR33339
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: JW07247
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: LV56361
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: VY28267
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY28267%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for VY28267: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: ZW73484
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: JF75670
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: EU98432
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: FH30373
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH30373%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for FH30373: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: UK08613
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: XX98366
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX98366%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for XX98366: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: NL75511
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: LL24572
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL24572%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for LL24572: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: FT04300
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT04300%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for FT04300: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: GX91950
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX91950%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for GX91950: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: TZ81028
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ81028%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for TZ81028: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: ZC95482
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC95482%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for ZC95482: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: XJ69303
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: UU89702
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU89702%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for UU89702: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: VC68158
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: JC38983
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC38983%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for JC38983: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: VR01411
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: PD45625
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: ND59157
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND59157%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for ND59157: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: VY26684
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY26684%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for VY26684: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: MK23766
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: VC05043
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC05043%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for VC05043: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: UH68821
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: UP55531
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: BR35184
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR35184%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for BR35184: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: KK03288
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK03288%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for KK03288: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: AR59073
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: HP42544
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP42544%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for HP42544: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: UP27315
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: CR84391
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR84391%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for CR84391: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: ZM86466
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM86466%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for ZM86466: 0
2026-03-30 11:28:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:36 [auto1.es] INFO: Channel: 24h | Page: 49 | totalHits: 2239 | hits on page: 40
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: ZM86466
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM86466%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for ZM86466: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: KD09714
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD09714%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for KD09714: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: VP18393
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP18393%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for VP18393: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: GV40212
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV40212%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for GV40212: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: NY33487
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY33487%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for NY33487: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: JT33139
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT33139%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for JT33139: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: NW63422
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: XN45249
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: DS74778
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS74778%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for DS74778: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: MD70003
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD70003%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for MD70003: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: AM05329
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: BY33283
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY33283%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for BY33283: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: VU28227
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: ZL27133
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27133%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for ZL27133: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: AP64153
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP64153%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for AP64153: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: JZ51794
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ51794%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for JZ51794: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: RD07091
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: JG89903
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: LE34718
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: GX38118
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: ZM34932
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: CG09187
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG09187%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for CG09187: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: EB62750
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB62750%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for EB62750: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: TK95363
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: WN54679
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN54679%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for WN54679: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: SW23101
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW23101%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for SW23101: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: LC59267
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC59267%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for LC59267: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: ZL32724
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: YK51395
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: GL92788
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: VF01083
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: BG05674
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: UD80298
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: FZ04394
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ04394%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for FZ04394: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: YL06778
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: AV93278
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: MP31569
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP31569%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for MP31569: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: GR78945
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR78945%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for GR78945: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: CR48575
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: JY09497
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY09497%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for JY09497: 0
2026-03-30 11:28:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:53 [auto1.es] INFO: Channel: 24h | Page: 50 | totalHits: 2240 | hits on page: 40
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: JY09497
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY09497%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for JY09497: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: BZ21450
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: UT89838
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: JX90216
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: DC35826
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: FG81749
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG81749%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for FG81749: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: BR13060
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR13060%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for BR13060: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: HA51253
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA51253%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for HA51253: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: RR74853
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR74853%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for RR74853: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: GE94512
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: CY04008
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: JV95856
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JV95856%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for JV95856: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: CM70741
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: DC47971
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: DD74793
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: VT11458
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT11458%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for VT11458: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: XC40695
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC40695%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for XC40695: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: TT72287
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: EY91693
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY91693%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for EY91693: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: PW28611
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: ME07403
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: JR29098
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR29098%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for JR29098: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: JE65744
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE65744%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for JE65744: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: RU65769
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU65769%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for RU65769: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: LC77404
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: FK65100
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK65100%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for FK65100: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: LS69638
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: XG18917
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG18917%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for XG18917: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: FU29422
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: FX14772
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX14772%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for FX14772: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: ML17412
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML17412%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for ML17412: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: KC46578
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC46578%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for KC46578: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: XR73155
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR73155%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for XR73155: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: RK55405
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: MW76524
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW76524%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for MW76524: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: PL96310
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL96310%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for PL96310: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: XZ20616
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: DL51279
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: KD88168
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: LP98864
2026-03-30 11:28:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:04 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 4 pages/min), scraped 233 items (at 0 items/min)
2026-03-30 11:29:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:26 [auto1.es] INFO: Channel: 24h | Page: 51 | totalHits: 2241 | hits on page: 40
2026-03-30 11:29:26 [auto1.es] INFO: Found listing with ID: LP98864
2026-03-30 11:29:26 [auto1.es] INFO: Found listing with ID: SZ95909
2026-03-30 11:29:26 [auto1.es] INFO: Found listing with ID: YK45669
2026-03-30 11:29:26 [auto1.es] INFO: Found listing with ID: ZN14981
2026-03-30 11:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN14981%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for ZN14981: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: XX41705
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: KE50509
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE50509%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for KE50509: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: RR11017
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: WX13119
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX13119%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for WX13119: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: XF66468
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: WZ85087
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ85087%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for WZ85087: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: CT91769
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: TT49974
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: AE24734
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: YW75502
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW75502%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for YW75502: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: JY28028
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: CT45338
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: WZ34012
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ34012%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for WZ34012: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: MT58726
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT58726%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for MT58726: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: KT63961
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: ZA21810
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: VR29926
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR29926%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for VR29926: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: SV29323
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV29323%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for SV29323: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: VT96833
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT96833%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for VT96833: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: BE63337
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE63337%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for BE63337: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: RH33829
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH33829%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for RH33829: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: EY86051
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: RK09701
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: MY48214
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY48214%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for MY48214: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: SM51869
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: UN59874
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN59874%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for UN59874: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: DH56387
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH56387%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for DH56387: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: SC27418
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC27418%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for SC27418: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: ZJ95453
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ95453%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for ZJ95453: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: HR31272
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR31272%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for HR31272: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: PA92548
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: LM00276
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: YU51978
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: MA61689
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: ED57476
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED57476%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for ED57476: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: TW11063
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW11063%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for TW11063: 0
2026-03-30 11:29:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:43 [auto1.es] INFO: Channel: 24h | Page: 52 | totalHits: 2241 | hits on page: 40
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: RN82930
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN82930%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.es] INFO: Scrape type for RN82930: 0
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: MF36359
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: JG85850
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: FC13262
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: ZW97071
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: EG32676
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG32676%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.es] INFO: Scrape type for EG32676: 0
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: VC62552
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC62552%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.es] INFO: Scrape type for VC62552: 0
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: PF61621
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF61621%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.es] INFO: Scrape type for PF61621: 0
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: CP49442
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: AD67761
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD67761%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.es] INFO: Scrape type for AD67761: 0
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: RT04886
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: GA00375
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA00375%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.es] INFO: Scrape type for GA00375: 0
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: ZJ56625
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ56625%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.es] INFO: Scrape type for ZJ56625: 0
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: VN13138
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: ZC64345
2026-03-30 11:29:43 [auto1.es] INFO: Found listing with ID: AR88261
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR88261%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for AR88261: 0
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: MD04984
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: MU93951
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: WV15930
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV15930%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for WV15930: 0
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: WW30264
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: UF95473
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: TH31010
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH31010%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for TH31010: 0
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: TZ65854
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: TD60260
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: UL24539
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL24539%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for UL24539: 0
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: TB73704
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB73704%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for TB73704: 0
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: GB72499
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB72499%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for GB72499: 0
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: RY22174
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: TX70336
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX70336%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for TX70336: 0
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: MA61086
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: YH86623
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH86623%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for YH86623: 0
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: YX68233
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: SV12911
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: EJ16249
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: AS19038
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS19038%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for AS19038: 0
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: YH97828
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: GZ44252
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: BF55946
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: WV47930
2026-03-30 11:29:44 [auto1.es] INFO: Found listing with ID: YJ04642
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ04642%27 HTTP/1.1" 200 None
2026-03-30 11:29:44 [auto1.es] INFO: Scrape type for YJ04642: 0
2026-03-30 11:29:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:51 [auto1.es] INFO: Channel: 24h | Page: 53 | totalHits: 2241 | hits on page: 40
2026-03-30 11:29:51 [auto1.es] INFO: Found listing with ID: KZ49779
2026-03-30 11:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ49779%27 HTTP/1.1" 200 None
2026-03-30 11:29:51 [auto1.es] INFO: Scrape type for KZ49779: 0
2026-03-30 11:29:51 [auto1.es] INFO: Found listing with ID: ET46210
2026-03-30 11:29:51 [auto1.es] INFO: Found listing with ID: KP17570
2026-03-30 11:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP17570%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for KP17570: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: FG46245
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: KR67716
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: CA13811
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: GP65825
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: KH58937
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: ZT52456
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: LA57781
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: DM84841
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: TL38815
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: DS90195
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: FY96744
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: VP19091
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: NH85653
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH85653%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for NH85653: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: BZ65753
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ65753%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for BZ65753: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: PK26809
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK26809%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for PK26809: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: GH53703
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH53703%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for GH53703: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: HH60103
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: DY61189
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: FJ44146
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: SF85973
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF85973%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for SF85973: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: EK60433
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK60433%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for EK60433: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: ZT13794
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT13794%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for ZT13794: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: VA59339
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: DY95344
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY95344%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for DY95344: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: DC79827
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC79827%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for DC79827: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: BL04446
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: YV38932
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: MW67047
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW67047%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for MW67047: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: VU55173
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU55173%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for VU55173: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: KL23416
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: BM49479
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: ZV45444
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV45444%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for ZV45444: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: UD75301
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD75301%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for UD75301: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: CD83035
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD83035%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for CD83035: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: PZ56509
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: AJ69515
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ69515%27 HTTP/1.1" 200 None
2026-03-30 11:29:52 [auto1.es] INFO: Scrape type for AJ69515: 0
2026-03-30 11:29:52 [auto1.es] INFO: Found listing with ID: YS20114
2026-03-30 11:29:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:56 [auto1.es] INFO: Channel: 24h | Page: 54 | totalHits: 2242 | hits on page: 40
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: YS20114
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: AU66709
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU66709%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for AU66709: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: EK69979
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: CS18132
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: AS37941
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS37941%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for AS37941: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: HC11332
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC11332%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for HC11332: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: UN29242
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN29242%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for UN29242: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: ZX62184
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX62184%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for ZX62184: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: BW10675
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW10675%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for BW10675: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: MG85806
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG85806%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for MG85806: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: DX19120
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX19120%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for DX19120: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: KS42658
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS42658%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for KS42658: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: UE67433
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE67433%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for UE67433: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: TZ01977
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ01977%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for TZ01977: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: GW37320
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: GG74961
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG74961%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for GG74961: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: XW94395
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW94395%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for XW94395: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: PK32914
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: GW88114
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: LZ33351
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: TR19943
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: JS77996
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: ES07988
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES07988%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for ES07988: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: VZ79262
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ79262%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for VZ79262: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: HA87935
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: XC96716
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC96716%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for XC96716: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: VC74313
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC74313%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for VC74313: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: RG03753
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG03753%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for RG03753: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: CN77625
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: XD32564
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: YK19704
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK19704%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for YK19704: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: AE50164
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE50164%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for AE50164: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: VD65621
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: JZ79034
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: UC73568
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: LN12503
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN12503%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for LN12503: 0
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: UM67436
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: DB51566
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: BA40352
2026-03-30 11:29:56 [auto1.es] INFO: Found listing with ID: JM41258
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM41258%27 HTTP/1.1" 200 None
2026-03-30 11:29:56 [auto1.es] INFO: Scrape type for JM41258: 0
2026-03-30 11:29:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:00 [auto1.es] INFO: Channel: 24h | Page: 55 | totalHits: 2242 | hits on page: 40
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: MW71818
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW71818%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for MW71818: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: HX86510
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX86510%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for HX86510: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: SX49726
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: PE94683
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: VJ61216
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: KX75561
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: GW51820
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: BT71977
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT71977%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for BT71977: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: CC89526
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC89526%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for CC89526: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: MY23078
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY23078%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for MY23078: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: PN58754
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN58754%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for PN58754: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: TS39016
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS39016%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for TS39016: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: ZK42012
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: PS53569
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS53569%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for PS53569: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: LG52328
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: RF71791
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF71791%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for RF71791: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: GE54234
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE54234%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for GE54234: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: XP71209
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP71209%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for XP71209: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: AT12035
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT12035%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for AT12035: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: BT51966
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: YD38751
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: LR44040
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: LV43298
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV43298%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for LV43298: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: LS22424
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS22424%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for LS22424: 0
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: MB84722
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: SR36141
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: UB86701
2026-03-30 11:30:01 [auto1.es] INFO: Found listing with ID: MD68479
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD68479%27 HTTP/1.1" 200 None
2026-03-30 11:30:01 [auto1.es] INFO: Scrape type for MD68479: 2
2026-03-30 11:30:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 061e6b20-34c6-585b-a203-e7dc88c0288b with identifier: MD68479
2026-03-30 11:30:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 061e6b20-34c6-585b-a203-e7dc88c0288b with scrape type 2
2026-03-30 11:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 061e6b20-34c6-585b-a203-e7dc88c0288b with scrape type 2
2026-03-30 11:30:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 061e6b20-34c6-585b-a203-e7dc88c0288b, identifier: MD68479
2026-03-30 11:30:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 061e6b20-34c6-585b-a203-e7dc88c0288b with identifier: MD68479
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 11:30:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:30:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 061e6b20-34c6-585b-a203-e7dc88c0288b with identifier: MD68479
2026-03-30 11:30:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 061e6b20-34c6-585b-a203-e7dc88c0288b with identifier: MD68479 to the API
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:02:48Z',
 'fuel_type': 'hybrid',
 'id': '061e6b20-34c6-585b-a203-e7dc88c0288b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD68479',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 63212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-22',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD68479%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.es] INFO: Saving data for MD68479: {'auction_closing_time': 1774882968.0, 'created_time': 1774695681.244992, 'last_price_update_time': 1774870202.569027}
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MD68479') HTTP/1.1" 204 0
2026-03-30 11:30:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:02 [auto1.es] INFO: Found listing with ID: NV64390
2026-03-30 11:30:02 [auto1.es] INFO: Found listing with ID: UP08006
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08006%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.es] INFO: Scrape type for UP08006: 2
2026-03-30 11:30:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a09408-3e64-5977-9dde-0ec17d510ef0 with identifier: UP08006
2026-03-30 11:30:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a09408-3e64-5977-9dde-0ec17d510ef0 with scrape type 2
2026-03-30 11:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a09408-3e64-5977-9dde-0ec17d510ef0 with scrape type 2
2026-03-30 11:30:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15a09408-3e64-5977-9dde-0ec17d510ef0, identifier: UP08006
2026-03-30 11:30:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15a09408-3e64-5977-9dde-0ec17d510ef0 with identifier: UP08006
2026-03-30 11:30:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15a09408-3e64-5977-9dde-0ec17d510ef0 with identifier: UP08006
2026-03-30 11:30:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15a09408-3e64-5977-9dde-0ec17d510ef0 with identifier: UP08006 to the API
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:56:12Z',
 'fuel_type': 'petrol',
 'id': '15a09408-3e64-5977-9dde-0ec17d510ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP08006',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 182549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08006%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.es] INFO: Saving data for UP08006: {'auction_closing_time': 1774886172.0, 'created_time': 1773432310.696511, 'last_price_update_time': 1774870203.608994}
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UP08006') HTTP/1.1" 204 0
2026-03-30 11:30:03 [auto1.es] INFO: Found listing with ID: HP31470
2026-03-30 11:30:03 [auto1.es] INFO: Found listing with ID: TW94946
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW94946%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.es] INFO: Scrape type for TW94946: 2
2026-03-30 11:30:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946
2026-03-30 11:30:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf8b380-754a-554a-842f-ebb4023ee0d4 with scrape type 2
2026-03-30 11:30:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abf8b380-754a-554a-842f-ebb4023ee0d4 with scrape type 2
2026-03-30 11:30:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: abf8b380-754a-554a-842f-ebb4023ee0d4, identifier: TW94946
2026-03-30 11:30:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946
2026-03-30 11:30:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946
2026-03-30 11:30:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946 to the API
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:25:25Z',
 'fuel_type': 'diesel',
 'id': 'abf8b380-754a-554a-842f-ebb4023ee0d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW94946',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 108969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-28',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2007}
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW94946%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.es] INFO: Saving data for TW94946: {'auction_closing_time': 1774884325.0, 'created_time': 1774015595.87794, 'last_price_update_time': 1774870204.736372}
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW94946') HTTP/1.1" 204 0
2026-03-30 11:30:04 [auto1.es] INFO: Found listing with ID: RF07402
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF07402%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.es] INFO: Scrape type for RF07402: 2
2026-03-30 11:30:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with identifier: RF07402
2026-03-30 11:30:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with scrape type 2
2026-03-30 11:30:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with scrape type 2
2026-03-30 11:30:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ed9aced-5f26-5a9e-9b88-a649a22c4869, identifier: RF07402
2026-03-30 11:30:04 [scrapy.extensions.logstats] INFO: Crawled 218 pages (at 5 pages/min), scraped 236 items (at 3 items/min)
2026-03-30 11:30:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 11:30:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with identifier: RF07402
2026-03-30 11:30:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with identifier: RF07402
2026-03-30 11:30:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with identifier: RF07402 to the API
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:16:17Z',
 'fuel_type': 'hybrid',
 'id': '5ed9aced-5f26-5a9e-9b88-a649a22c4869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF07402',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 199517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-25',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Tecno',
 'transmission': 'automatic',
 'trim': 'Tecno',
 'year': 2017}
2026-03-30 11:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF07402%27 HTTP/1.1" 200 None
2026-03-30 11:30:05 [auto1.es] INFO: Saving data for RF07402: {'auction_closing_time': 1774883777.0, 'created_time': 1773410560.602644, 'last_price_update_time': 1774870205.487603}
2026-03-30 11:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RF07402') HTTP/1.1" 204 0
2026-03-30 11:30:05 [auto1.es] INFO: Found listing with ID: YJ22884
2026-03-30 11:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ22884%27 HTTP/1.1" 200 None
2026-03-30 11:30:05 [auto1.es] INFO: Scrape type for YJ22884: 2
2026-03-30 11:30:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 602bfb9c-aebb-50d7-919a-bdba3935274d with identifier: YJ22884
2026-03-30 11:30:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 602bfb9c-aebb-50d7-919a-bdba3935274d with scrape type 2
2026-03-30 11:30:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 602bfb9c-aebb-50d7-919a-bdba3935274d with scrape type 2
2026-03-30 11:30:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 602bfb9c-aebb-50d7-919a-bdba3935274d, identifier: YJ22884
2026-03-30 11:30:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 602bfb9c-aebb-50d7-919a-bdba3935274d with identifier: YJ22884
2026-03-30 11:30:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 602bfb9c-aebb-50d7-919a-bdba3935274d with identifier: YJ22884
2026-03-30 11:30:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 602bfb9c-aebb-50d7-919a-bdba3935274d with identifier: YJ22884 to the API
2026-03-30 11:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:14:57Z',
 'fuel_type': 'diesel',
 'id': '602bfb9c-aebb-50d7-919a-bdba3935274d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ22884',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 168516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-30 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ22884%27 HTTP/1.1" 200 None
2026-03-30 11:30:06 [auto1.es] INFO: Saving data for YJ22884: {'auction_closing_time': 1774883697.0, 'created_time': 1774695692.520443, 'last_price_update_time': 1774870206.831042}
2026-03-30 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ22884') HTTP/1.1" 204 0
2026-03-30 11:30:06 [auto1.es] INFO: Found listing with ID: UE40961
2026-03-30 11:30:06 [auto1.es] INFO: Found listing with ID: MK70823
2026-03-30 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK70823%27 HTTP/1.1" 200 None
2026-03-30 11:30:06 [auto1.es] INFO: Scrape type for MK70823: 2
2026-03-30 11:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823
2026-03-30 11:30:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043be3b6-9f94-5190-9dea-94f99414cd15 with scrape type 2
2026-03-30 11:30:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043be3b6-9f94-5190-9dea-94f99414cd15 with scrape type 2
2026-03-30 11:30:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 043be3b6-9f94-5190-9dea-94f99414cd15, identifier: MK70823
2026-03-30 11:30:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823
2026-03-30 11:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823
2026-03-30 11:30:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823 to the API
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:51:43Z',
 'fuel_type': 'diesel',
 'id': '043be3b6-9f94-5190-9dea-94f99414cd15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK70823',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 89468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-02',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK70823%27 HTTP/1.1" 200 None
2026-03-30 11:30:07 [auto1.es] INFO: Saving data for MK70823: {'auction_closing_time': 1774885903.0, 'created_time': 1773399792.831716, 'last_price_update_time': 1774870207.949128}
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MK70823') HTTP/1.1" 204 0
2026-03-30 11:30:07 [auto1.es] INFO: Found listing with ID: WV13003
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV13003%27 HTTP/1.1" 200 None
2026-03-30 11:30:07 [auto1.es] INFO: Scrape type for WV13003: 2
2026-03-30 11:30:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08fa0f52-780c-563f-be19-5092d0863191 with identifier: WV13003
2026-03-30 11:30:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08fa0f52-780c-563f-be19-5092d0863191 with scrape type 2
2026-03-30 11:30:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08fa0f52-780c-563f-be19-5092d0863191 with scrape type 2
2026-03-30 11:30:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08fa0f52-780c-563f-be19-5092d0863191, identifier: WV13003
2026-03-30 11:30:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08fa0f52-780c-563f-be19-5092d0863191 with identifier: WV13003
2026-03-30 11:30:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08fa0f52-780c-563f-be19-5092d0863191 with identifier: WV13003
2026-03-30 11:30:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08fa0f52-780c-563f-be19-5092d0863191 with identifier: WV13003 to the API
2026-03-30 11:30:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:01:52Z',
 'fuel_type': 'diesel',
 'id': '08fa0f52-780c-563f-be19-5092d0863191',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV13003',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 356404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-27',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 11:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV13003%27 HTTP/1.1" 200 None
2026-03-30 11:30:08 [auto1.es] INFO: Saving data for WV13003: {'auction_closing_time': 1774882912.0, 'created_time': 1773410452.544435, 'last_price_update_time': 1774870208.338406}
2026-03-30 11:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WV13003') HTTP/1.1" 204 0
2026-03-30 11:30:08 [auto1.es] INFO: Found listing with ID: SR52978
2026-03-30 11:30:08 [auto1.es] INFO: Found listing with ID: BA23720
2026-03-30 11:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA23720%27 HTTP/1.1" 200 None
2026-03-30 11:30:08 [auto1.es] INFO: Scrape type for BA23720: 2
2026-03-30 11:30:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with identifier: BA23720
2026-03-30 11:30:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with scrape type 2
2026-03-30 11:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with scrape type 2
2026-03-30 11:30:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4a563d7e-6b23-5f9a-bfd7-01238a25b947, identifier: BA23720
2026-03-30 11:30:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with identifier: BA23720
2026-03-30 11:30:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with identifier: BA23720
2026-03-30 11:30:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with identifier: BA23720 to the API
2026-03-30 11:30:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:03:13Z',
 'fuel_type': 'petrol',
 'id': '4a563d7e-6b23-5f9a-bfd7-01238a25b947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA23720',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 124070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-28',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.4 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2008}
2026-03-30 11:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA23720%27 HTTP/1.1" 200 None
2026-03-30 11:30:09 [auto1.es] INFO: Saving data for BA23720: {'auction_closing_time': 1774882993.0, 'created_time': 1773128176.877031, 'last_price_update_time': 1774870209.778066}
2026-03-30 11:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BA23720') HTTP/1.1" 204 0
2026-03-30 11:30:09 [auto1.es] INFO: Found listing with ID: PL84711
2026-03-30 11:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL84711%27 HTTP/1.1" 200 None
2026-03-30 11:30:09 [auto1.es] INFO: Scrape type for PL84711: 2
2026-03-30 11:30:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e92a793c-beb5-5b36-baa4-38f1e0876a4a with identifier: PL84711
2026-03-30 11:30:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e92a793c-beb5-5b36-baa4-38f1e0876a4a with scrape type 2
2026-03-30 11:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e92a793c-beb5-5b36-baa4-38f1e0876a4a with scrape type 2
2026-03-30 11:30:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e92a793c-beb5-5b36-baa4-38f1e0876a4a, identifier: PL84711
2026-03-30 11:30:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e92a793c-beb5-5b36-baa4-38f1e0876a4a with identifier: PL84711
2026-03-30 11:30:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e92a793c-beb5-5b36-baa4-38f1e0876a4a with identifier: PL84711
2026-03-30 11:30:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e92a793c-beb5-5b36-baa4-38f1e0876a4a with identifier: PL84711 to the API
2026-03-30 11:30:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:32Z',
 'fuel_type': 'diesel',
 'id': 'e92a793c-beb5-5b36-baa4-38f1e0876a4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL84711',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 342324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-17',
 'seller_name': None,
 'title': 'Ford C-Max 1.8 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2008}
2026-03-30 11:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL84711%27 HTTP/1.1" 200 None
2026-03-30 11:30:11 [auto1.es] INFO: Saving data for PL84711: {'auction_closing_time': 1774885712.0, 'created_time': 1774695662.76442, 'last_price_update_time': 1774870211.961587}
2026-03-30 11:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PL84711') HTTP/1.1" 204 0
2026-03-30 11:30:11 [auto1.es] INFO: Channel: 24h | Page: 56 | totalHits: 2242 | hits on page: 40
2026-03-30 11:30:11 [auto1.es] INFO: Found listing with ID: AZ04928
2026-03-30 11:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ04928%27 HTTP/1.1" 200 None
2026-03-30 11:30:12 [auto1.es] INFO: Scrape type for AZ04928: 2
2026-03-30 11:30:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928
2026-03-30 11:30:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with scrape type 2
2026-03-30 11:30:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with scrape type 2
2026-03-30 11:30:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00, identifier: AZ04928
2026-03-30 11:30:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928
2026-03-30 11:30:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928
2026-03-30 11:30:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928 to the API
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:53:40Z',
 'fuel_type': 'hybrid',
 'id': '14379ca0-cb74-5f2d-9aca-09ef90b2bc00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ04928',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 46061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-23',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2020}
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ04928%27 HTTP/1.1" 200 None
2026-03-30 11:30:12 [auto1.es] INFO: Saving data for AZ04928: {'auction_closing_time': 1774886020.0, 'created_time': 1774001891.140795, 'last_price_update_time': 1774870212.898673}
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AZ04928') HTTP/1.1" 204 0
2026-03-30 11:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:12 [auto1.es] INFO: Found listing with ID: JA60709
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA60709%27 HTTP/1.1" 200 None
2026-03-30 11:30:12 [auto1.es] INFO: Scrape type for JA60709: 2
2026-03-30 11:30:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c7167d-998f-5158-8c3e-37400bed320b with identifier: JA60709
2026-03-30 11:30:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c7167d-998f-5158-8c3e-37400bed320b with scrape type 2
2026-03-30 11:30:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68c7167d-998f-5158-8c3e-37400bed320b with scrape type 2
2026-03-30 11:30:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68c7167d-998f-5158-8c3e-37400bed320b, identifier: JA60709
2026-03-30 11:30:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68c7167d-998f-5158-8c3e-37400bed320b with identifier: JA60709
2026-03-30 11:30:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68c7167d-998f-5158-8c3e-37400bed320b with identifier: JA60709
2026-03-30 11:30:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 68c7167d-998f-5158-8c3e-37400bed320b with identifier: JA60709 to the API
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:17:06Z',
 'fuel_type': 'diesel',
 'id': '68c7167d-998f-5158-8c3e-37400bed320b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA60709',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 206264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-30',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 11:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA60709%27 HTTP/1.1" 200 None
2026-03-30 11:30:14 [auto1.es] INFO: Saving data for JA60709: {'auction_closing_time': 1774883826.0, 'created_time': 1773410524.684106, 'last_price_update_time': 1774870214.116738}
2026-03-30 11:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JA60709') HTTP/1.1" 204 0
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: EF82008
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: TX62344
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: ML70720
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: DL67174
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: MS21138
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: EG18417
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: HD15587
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: BE52894
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: BE06656
2026-03-30 11:30:14 [auto1.es] INFO: Found listing with ID: KW41207
2026-03-30 11:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW41207%27 HTTP/1.1" 200 None
2026-03-30 11:30:14 [auto1.es] INFO: Scrape type for KW41207: 2
2026-03-30 11:30:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207
2026-03-30 11:30:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09f6640-f68b-5e2e-86fe-53c0624e6dfc with scrape type 2
2026-03-30 11:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09f6640-f68b-5e2e-86fe-53c0624e6dfc with scrape type 2
2026-03-30 11:30:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a09f6640-f68b-5e2e-86fe-53c0624e6dfc, identifier: KW41207
2026-03-30 11:30:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207
2026-03-30 11:30:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207
2026-03-30 11:30:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207 to the API
2026-03-30 11:30:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:27:01Z',
 'fuel_type': 'diesel',
 'id': 'a09f6640-f68b-5e2e-86fe-53c0624e6dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW41207',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 112407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-02',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Reference Copa',
 'transmission': 'manual',
 'trim': 'Reference Copa',
 'year': 2011}
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW41207%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.es] INFO: Saving data for KW41207: {'auction_closing_time': 1774884421.0, 'created_time': 1774015494.131213, 'last_price_update_time': 1774870215.3777}
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KW41207') HTTP/1.1" 204 0
2026-03-30 11:30:15 [auto1.es] INFO: Found listing with ID: DZ14313
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ14313%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.es] INFO: Scrape type for DZ14313: 2
2026-03-30 11:30:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313
2026-03-30 11:30:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with scrape type 2
2026-03-30 11:30:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with scrape type 2
2026-03-30 11:30:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7, identifier: DZ14313
2026-03-30 11:30:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313
2026-03-30 11:30:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313
2026-03-30 11:30:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313 to the API
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:17Z',
 'fuel_type': 'petrol',
 'id': 'af095160-2b8c-51a6-92d0-ac9e8b1e6fa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ14313',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 141564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ14313%27 HTTP/1.1" 200 None
2026-03-30 11:30:16 [auto1.es] INFO: Saving data for DZ14313: {'auction_closing_time': 1774885097.0, 'created_time': 1774015650.665335, 'last_price_update_time': 1774870216.398935}
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DZ14313') HTTP/1.1" 204 0
2026-03-30 11:30:16 [auto1.es] INFO: Found listing with ID: GB85500
2026-03-30 11:30:16 [auto1.es] INFO: Found listing with ID: SX89883
2026-03-30 11:30:16 [auto1.es] INFO: Found listing with ID: FN14601
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN14601%27 HTTP/1.1" 200 None
2026-03-30 11:30:16 [auto1.es] INFO: Scrape type for FN14601: 2
2026-03-30 11:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601
2026-03-30 11:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec82a39-ff08-50d5-9d41-f2c30f9528c2 with scrape type 2
2026-03-30 11:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec82a39-ff08-50d5-9d41-f2c30f9528c2 with scrape type 2
2026-03-30 11:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eec82a39-ff08-50d5-9d41-f2c30f9528c2, identifier: FN14601
2026-03-30 11:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601
2026-03-30 11:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601
2026-03-30 11:30:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601 to the API
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:26:56Z',
 'fuel_type': 'diesel',
 'id': 'eec82a39-ff08-50d5-9d41-f2c30f9528c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN14601',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 17423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-15',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 30 mittellang FWD',
 'transmission': 'manual',
 'trim': 'Kasten 30 mittellang FWD',
 'year': 2025}
2026-03-30 11:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN14601%27 HTTP/1.1" 200 None
2026-03-30 11:30:17 [auto1.es] INFO: Saving data for FN14601: {'auction_closing_time': 1774884416.0, 'created_time': 1774015690.034891, 'last_price_update_time': 1774870217.596379}
2026-03-30 11:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN14601') HTTP/1.1" 204 0
2026-03-30 11:30:17 [auto1.es] INFO: Found listing with ID: UG73300
2026-03-30 11:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG73300%27 HTTP/1.1" 200 None
2026-03-30 11:30:17 [auto1.es] INFO: Scrape type for UG73300: 2
2026-03-30 11:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with identifier: UG73300
2026-03-30 11:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with scrape type 2
2026-03-30 11:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with scrape type 2
2026-03-30 11:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 460b4d1c-b5da-54b0-9911-7f10bf902ac6, identifier: UG73300
2026-03-30 11:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with identifier: UG73300
2026-03-30 11:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with identifier: UG73300
2026-03-30 11:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with identifier: UG73300 to the API
2026-03-30 11:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:03:02Z',
 'fuel_type': 'diesel',
 'id': '460b4d1c-b5da-54b0-9911-7f10bf902ac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG73300',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 109464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-25',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 HDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 11:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG73300%27 HTTP/1.1" 200 None
2026-03-30 11:30:18 [auto1.es] INFO: Saving data for UG73300: {'auction_closing_time': 1774882982.0, 'created_time': 1772753272.57651, 'last_price_update_time': 1774870218.052198}
2026-03-30 11:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG73300') HTTP/1.1" 204 0
2026-03-30 11:30:18 [auto1.es] INFO: Found listing with ID: CE73826
2026-03-30 11:30:18 [auto1.es] INFO: Found listing with ID: DW64016
2026-03-30 11:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW64016%27 HTTP/1.1" 200 None
2026-03-30 11:30:18 [auto1.es] INFO: Scrape type for DW64016: 2
2026-03-30 11:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc22b351-d8ec-5f29-92d4-94887b58b5f9 with identifier: DW64016
2026-03-30 11:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc22b351-d8ec-5f29-92d4-94887b58b5f9 with scrape type 2
2026-03-30 11:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc22b351-d8ec-5f29-92d4-94887b58b5f9 with scrape type 2
2026-03-30 11:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc22b351-d8ec-5f29-92d4-94887b58b5f9, identifier: DW64016
2026-03-30 11:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc22b351-d8ec-5f29-92d4-94887b58b5f9 with identifier: DW64016
2026-03-30 11:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc22b351-d8ec-5f29-92d4-94887b58b5f9 with identifier: DW64016
2026-03-30 11:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc22b351-d8ec-5f29-92d4-94887b58b5f9 with identifier: DW64016 to the API
2026-03-30 11:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:25:19Z',
 'fuel_type': 'petrol',
 'id': 'dc22b351-d8ec-5f29-92d4-94887b58b5f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW64016',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 229901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-04',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW64016%27 HTTP/1.1" 200 None
2026-03-30 11:30:19 [auto1.es] INFO: Saving data for DW64016: {'auction_closing_time': 1774884319.0, 'created_time': 1773410545.760771, 'last_price_update_time': 1774870219.433081}
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DW64016') HTTP/1.1" 204 0
2026-03-30 11:30:19 [auto1.es] INFO: Found listing with ID: XB82673
2026-03-30 11:30:19 [auto1.es] INFO: Found listing with ID: RV29319
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV29319%27 HTTP/1.1" 200 None
2026-03-30 11:30:19 [auto1.es] INFO: Scrape type for RV29319: 2
2026-03-30 11:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with identifier: RV29319
2026-03-30 11:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with scrape type 2
2026-03-30 11:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with scrape type 2
2026-03-30 11:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8, identifier: RV29319
2026-03-30 11:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with identifier: RV29319
2026-03-30 11:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with identifier: RV29319
2026-03-30 11:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with identifier: RV29319 to the API
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:06:59Z',
 'fuel_type': 'petrol',
 'id': '1b1011a5-0579-5d76-8cc1-f27fcb78e0b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV29319',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 91463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV29319%27 HTTP/1.1" 200 None
2026-03-30 11:30:19 [auto1.es] INFO: Saving data for RV29319: {'auction_closing_time': 1774883219.0, 'created_time': 1774695644.499627, 'last_price_update_time': 1774870219.861067}
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RV29319') HTTP/1.1" 204 0
2026-03-30 11:30:19 [auto1.es] INFO: Found listing with ID: US62634
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62634%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.es] INFO: Scrape type for US62634: 2
2026-03-30 11:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634
2026-03-30 11:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293340dc-a86b-5def-944a-801bccd1ff63 with scrape type 2
2026-03-30 11:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293340dc-a86b-5def-944a-801bccd1ff63 with scrape type 2
2026-03-30 11:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 293340dc-a86b-5def-944a-801bccd1ff63, identifier: US62634
2026-03-30 11:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 11:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 11:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634
2026-03-30 11:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634 to the API
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:52:43Z',
 'fuel_type': 'gas',
 'id': '293340dc-a86b-5def-944a-801bccd1ff63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US62634',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 33466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2022}
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62634%27 HTTP/1.1" 200 None
2026-03-30 11:30:21 [auto1.es] INFO: Saving data for US62634: {'auction_closing_time': 1774885963.0, 'created_time': 1772753596.812938, 'last_price_update_time': 1774870221.841003}
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='US62634') HTTP/1.1" 204 0
2026-03-30 11:30:21 [auto1.es] INFO: Found listing with ID: XN12672
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN12672%27 HTTP/1.1" 200 None
2026-03-30 11:30:21 [auto1.es] INFO: Scrape type for XN12672: 2
2026-03-30 11:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672
2026-03-30 11:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6cc0662-1e2a-51e2-abe4-c188536caecb with scrape type 2
2026-03-30 11:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6cc0662-1e2a-51e2-abe4-c188536caecb with scrape type 2
2026-03-30 11:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f6cc0662-1e2a-51e2-abe4-c188536caecb, identifier: XN12672
2026-03-30 11:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672
2026-03-30 11:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672
2026-03-30 11:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672 to the API
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:50:49Z',
 'fuel_type': 'petrol',
 'id': 'f6cc0662-1e2a-51e2-abe4-c188536caecb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN12672',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 61150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-28',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2016}
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN12672%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Saving data for XN12672: {'auction_closing_time': 1774885849.0, 'created_time': 1774015598.000568, 'last_price_update_time': 1774870222.292498}
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XN12672') HTTP/1.1" 204 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: RW91373
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: RP67068
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP67068%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for RP67068: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: LG74328
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: RF85744
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF85744%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for RF85744: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: YX32704
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX32704%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for YX32704: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: ZG63896
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: XN94474
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN94474%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for XN94474: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: VU26922
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: AG57096
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: CM29770
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM29770%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for CM29770: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: PU80612
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: RX82713
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX82713%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for RX82713: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: AE71783
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE71783%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for AE71783: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: GH02704
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: GR51630
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR51630%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for GR51630: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: CM09391
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM09391%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for CM09391: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: DU59373
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU59373%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for DU59373: 0
2026-03-30 11:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:32 [auto1.es] INFO: Channel: 24h | Page: 57 | totalHits: 2242 | hits on page: 2
2026-03-30 11:30:32 [auto1.es] INFO: Found listing with ID: ZH62909
2026-03-30 11:30:32 [auto1.es] INFO: Found listing with ID: HZ84685
2026-03-30 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84685%27 HTTP/1.1" 200 None
2026-03-30 11:30:32 [auto1.es] INFO: Scrape type for HZ84685: 0
2026-03-30 11:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:33 [auto1.es] INFO: Channel: 24h | Page: 58 | totalHits: 2242 | hits on page: 0
2026-03-30 11:30:33 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 11:30:33 [auto1.es] INFO: auto1.es Batch config: batch 1/2
2026-03-30 11:30:33 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 11, <ScrapeType.BATCH_SKIPPED: 5>: 8}
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC72972%27 HTTP/1.1" 200 None
2026-03-30 11:30:33 [auto1.es] INFO: Saving data for XC72972: {'created_time': 1774870233.135391}
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC72972') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20last_price_update_time%20lt%201774438233 HTTP/1.1" 200 None
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AN02596') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AV28749') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AX35472') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BC56074') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BD86383') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BF70680') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BS19936') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BV14173') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BW11598') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CC93871') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CG39677') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CM32787') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CS19439') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CS30479') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DB39204') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DC13181') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DE96356') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DJ67069') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EA22466') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EA37788') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EF26124') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EK41459') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EL30608') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ER15712') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FK20219') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FM47368') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FN44057') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GY79301') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HM30232') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HR97916') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HW59161') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JT35666') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JV17543') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KB16661') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KK63900') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KX61008') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LC08753') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ81240') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LX58466') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LY51257') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MA29184') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MB31857') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MU44345') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MW28654') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MY34770') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MY93772') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MZ95788') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ND26014') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NL68548') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NM45097') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NX15494') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PH07773') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PK96003') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PT53380') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PX11997') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ01168') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RA99093') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RB53246') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RE54590') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RE75922') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RF67148') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RG96205') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SX95799') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TJ11630') HTTP/1.1" 204 0
2026-03-30 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TJ78257') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TJ89849') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TR02854') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TR99734') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TU64699') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TU85694') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TV25890') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TW32004') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UF05276') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UH70980') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UK25236') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VN97814') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VS82276') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VW59943') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WE44709') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WM87692') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WN13560') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XA36689') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XB10951') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XD47010') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XF47817') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XH95895') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='YF90285') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='YV38239') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZS65134') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZU21817') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZY82238') HTTP/1.1" 204 0
2026-03-30 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZZ14583') HTTP/1.1" 204 0
2026-03-30 11:30:34 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (252 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_21_2026-03-30T11_00_00.jl
2026-03-30 11:30:34 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 1,
 'downloader/exception_type_count/zyte_api._errors.RequestError': 1,
 'downloader/request_bytes': 1090798,
 'downloader/request_count': 593,
 'downloader/request_method_count/GET': 533,
 'downloader/request_method_count/POST': 60,
 'downloader/response_bytes': 50566616,
 'downloader/response_count': 592,
 'downloader/response_status_count/200': 592,
 'dupefilter/filtered': 13,
 'elapsed_time_seconds': 1830.272799,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 11, 30, 34, 284387, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 252,
 'log_count/DEBUG': 8044,
 'log_count/ERROR': 1,
 'log_count/INFO': 8615,
 'memusage/max': 172474368,
 'memusage/startup': 147640320,
 'photo_download_count': 371,
 'request_depth_max': 61,
 'response_received_count': 221,
 'scheduler/dequeued': 593,
 'scheduler/dequeued/memory': 593,
 'scheduler/enqueued': 593,
 'scheduler/enqueued/memory': 593,
 'scrape_type/batch_skipped': 1144,
 'scrape_type/new': 80,
 'scrape_type/price_update': 173,
 'scrape_type/skipped': 872,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 263,
 'scrapy-zyte-api/error_ratio': 0.1596958174904943,
 'scrapy-zyte-api/error_types/download/temporary-error': 4,
 'scrapy-zyte-api/errors': 42,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 38,
 'scrapy-zyte-api/fatal_errors': 1,
 'scrapy-zyte-api/mean_connection_seconds': 14.413211328443138,
 'scrapy-zyte-api/mean_response_seconds': 14.240009419377722,
 'scrapy-zyte-api/processed': 222,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 222,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 221,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 222,
 'scrapy-zyte-api/request_args/httpRequestBody': 60,
 'scrapy-zyte-api/request_args/httpRequestMethod': 60,
 'scrapy-zyte-api/request_args/httpResponseBody': 222,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 222,
 'scrapy-zyte-api/request_args/sessionContext': 222,
 'scrapy-zyte-api/request_args/url': 222,
 'scrapy-zyte-api/status_codes/0': 38,
 'scrapy-zyte-api/status_codes/200': 221,
 'scrapy-zyte-api/status_codes/520': 4,
 'scrapy-zyte-api/success': 221,
 'scrapy-zyte-api/success_ratio': 0.9954954954954955,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 2282,
 'source/total_available': 2242,
 'start_time': datetime.datetime(2026, 3, 30, 11, 0, 4, 11588, tzinfo=datetime.timezone.utc)}
2026-03-30 11:30:34 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 11:30:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8cbd3e1350>
2026-03-30 11:30:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8cbd174050>