2026-03-27 19:10:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 19:10:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 19:10:06 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-27 19:10:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-27 19:10:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 19:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 19:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 19:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 19:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: fd85f7aeed123256
2026-03-27 19:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 19:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-27T19_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 19:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 19:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 19:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 19:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 19:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 19:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 19:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-27 19:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 19:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 19:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 19:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 19:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 19:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 19:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 19:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-27 19:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 19:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 19:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 19:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 19:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 19:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 19:10:16 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:16 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-27 19:10:16 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-27 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC45761%27 HTTP/1.1" 200 None
2026-03-27 19:10:16 [auto1.nl] INFO: Scrape type for VC45761: 2
2026-03-27 19:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8bf4793-763e-5ee9-8c2d-5aea2564e02a with identifier: VC45761
2026-03-27 19:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8bf4793-763e-5ee9-8c2d-5aea2564e02a with scrape type 2
2026-03-27 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8bf4793-763e-5ee9-8c2d-5aea2564e02a with scrape type 2
2026-03-27 19:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e8bf4793-763e-5ee9-8c2d-5aea2564e02a, identifier: VC45761
2026-03-27 19:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e8bf4793-763e-5ee9-8c2d-5aea2564e02a with identifier: VC45761
2026-03-27 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 19:10:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e8bf4793-763e-5ee9-8c2d-5aea2564e02a with identifier: VC45761
2026-03-27 19:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e8bf4793-763e-5ee9-8c2d-5aea2564e02a with identifier: VC45761 to the API
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:36:00Z',
 'fuel_type': 'diesel',
 'id': 'e8bf4793-763e-5ee9-8c2d-5aea2564e02a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC45761',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 174350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-07',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC45761%27 HTTP/1.1" 200 None
2026-03-27 19:10:17 [auto1.nl] INFO: Saving data for VC45761: {'auction_closing_time': 1774715760.0, 'created_time': 1774354592.569863, 'last_price_update_time': 1774638617.443509}
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VC45761') HTTP/1.1" 204 0
2026-03-27 19:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:17 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-27 19:10:17 [auto1.nl] INFO: Scrape type for CT54062: 2
2026-03-27 19:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-27 19:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1158f01-7d72-5e4e-a742-1f164b3c10f0 with scrape type 2
2026-03-27 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1158f01-7d72-5e4e-a742-1f164b3c10f0 with scrape type 2
2026-03-27 19:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1158f01-7d72-5e4e-a742-1f164b3c10f0, identifier: CT54062
2026-03-27 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-27 19:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062 to the API
2026-03-27 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:30:41Z',
 'fuel_type': 'petrol',
 'id': 'c1158f01-7d72-5e4e-a742-1f164b3c10f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT54062',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 25088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-09',
 'seller_name': None,
 'title': 'MINI Countryman Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2023}
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-27 19:10:18 [auto1.nl] INFO: Saving data for CT54062: {'auction_closing_time': 1774715441.0, 'created_time': 1773232326.734161, 'last_price_update_time': 1774638618.104883}
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT54062') HTTP/1.1" 204 0
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-27 19:10:18 [auto1.nl] INFO: Scrape type for RJ64387: 0
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-27 19:10:18 [auto1.nl] INFO: Scrape type for GL59810: 2
2026-03-27 19:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810
2026-03-27 19:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a61d4a81-1529-5666-b186-c114766bf705 with scrape type 2
2026-03-27 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a61d4a81-1529-5666-b186-c114766bf705 with scrape type 2
2026-03-27 19:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a61d4a81-1529-5666-b186-c114766bf705, identifier: GL59810
2026-03-27 19:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 19:10:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810
2026-03-27 19:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810 to the API
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:02Z',
 'fuel_type': 'petrol',
 'id': 'a61d4a81-1529-5666-b186-c114766bf705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL59810',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 155938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-27 19:10:18 [auto1.nl] INFO: Saving data for GL59810: {'auction_closing_time': 1774716422.0, 'created_time': 1773924411.943258, 'last_price_update_time': 1774638618.621668}
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GL59810') HTTP/1.1" 204 0
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG19961%27 HTTP/1.1" 200 None
2026-03-27 19:10:18 [auto1.nl] INFO: Scrape type for PG19961: 1
2026-03-27 19:10:18 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-27 19:10:18 [auto1.nl] INFO: Scrape type for YW05960: 2
2026-03-27 19:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9d5e81-0fb8-52df-bd71-e1f5295db733 with identifier: YW05960
2026-03-27 19:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9d5e81-0fb8-52df-bd71-e1f5295db733 with scrape type 2
2026-03-27 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b9d5e81-0fb8-52df-bd71-e1f5295db733 with scrape type 2
2026-03-27 19:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b9d5e81-0fb8-52df-bd71-e1f5295db733, identifier: YW05960
2026-03-27 19:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b9d5e81-0fb8-52df-bd71-e1f5295db733 with identifier: YW05960
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 19:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 19:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b9d5e81-0fb8-52df-bd71-e1f5295db733 with identifier: YW05960
2026-03-27 19:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b9d5e81-0fb8-52df-bd71-e1f5295db733 with identifier: YW05960 to the API
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-28T16:02:37Z',
 'fuel_type': 'hybrid',
 'id': '8b9d5e81-0fb8-52df-bd71-e1f5295db733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW05960',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 307939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-27',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription Luxe AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Luxe AWD',
 'year': 2015}
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-27 19:10:19 [auto1.nl] INFO: Saving data for YW05960: {'auction_closing_time': 1774713757.0, 'created_time': 1773837028.682789, 'last_price_update_time': 1774638619.921065}
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YW05960') HTTP/1.1" 204 0
2026-03-27 19:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:19 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-27 19:10:19 [auto1.nl] INFO: Scrape type for MM65316: 1
2026-03-27 19:10:19 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-27 19:10:19 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-27 19:10:19 [auto1.nl] INFO: Scrape type for VX32369: 2
2026-03-27 19:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00d233a4-c2b9-5329-8616-0b8d27ce1eb9 with identifier: VX32369
2026-03-27 19:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00d233a4-c2b9-5329-8616-0b8d27ce1eb9 with scrape type 2
2026-03-27 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00d233a4-c2b9-5329-8616-0b8d27ce1eb9 with scrape type 2
2026-03-27 19:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 00d233a4-c2b9-5329-8616-0b8d27ce1eb9, identifier: VX32369
2026-03-27 19:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 00d233a4-c2b9-5329-8616-0b8d27ce1eb9 with identifier: VX32369
2026-03-27 19:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 00d233a4-c2b9-5329-8616-0b8d27ce1eb9 with identifier: VX32369
2026-03-27 19:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 00d233a4-c2b9-5329-8616-0b8d27ce1eb9 with identifier: VX32369 to the API
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:59:20Z',
 'fuel_type': 'petrol',
 'id': '00d233a4-c2b9-5329-8616-0b8d27ce1eb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX32369',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 124848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-14',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-27 19:10:20 [auto1.nl] INFO: Saving data for VX32369: {'auction_closing_time': 1774717160.0, 'created_time': 1773132687.618518, 'last_price_update_time': 1774638620.35574}
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VX32369') HTTP/1.1" 204 0
2026-03-27 19:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:20 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-27 19:10:20 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-27 19:10:20 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-27 19:10:20 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-27 19:10:20 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-27 19:10:20 [auto1.nl] INFO: Scrape type for YP02517: 0
2026-03-27 19:10:20 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-27 19:10:20 [auto1.nl] INFO: Scrape type for NR59954: 2
2026-03-27 19:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-27 19:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a57a418-7494-5caa-99bb-22f2e88a16d7 with scrape type 2
2026-03-27 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a57a418-7494-5caa-99bb-22f2e88a16d7 with scrape type 2
2026-03-27 19:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a57a418-7494-5caa-99bb-22f2e88a16d7, identifier: NR59954
2026-03-27 19:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-27 19:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-27 19:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954 to the API
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:52:39Z',
 'fuel_type': 'petrol',
 'id': '8a57a418-7494-5caa-99bb-22f2e88a16d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR59954',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 319215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': None,
 'title': 'Volvo V70 1.6 T4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2012}
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-27 19:10:20 [auto1.nl] INFO: Saving data for NR59954: {'auction_closing_time': 1774716759.0, 'created_time': 1773232326.378528, 'last_price_update_time': 1774638620.778613}
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NR59954') HTTP/1.1" 204 0
2026-03-27 19:10:20 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-27 19:10:20 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH14183%27 HTTP/1.1" 200 None
2026-03-27 19:10:20 [auto1.nl] INFO: Scrape type for EH14183: 2
2026-03-27 19:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 512b9bb1-156f-5ede-8d04-9158e77074c8 with identifier: EH14183
2026-03-27 19:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 512b9bb1-156f-5ede-8d04-9158e77074c8 with scrape type 2
2026-03-27 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 512b9bb1-156f-5ede-8d04-9158e77074c8 with scrape type 2
2026-03-27 19:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 512b9bb1-156f-5ede-8d04-9158e77074c8, identifier: EH14183
2026-03-27 19:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 512b9bb1-156f-5ede-8d04-9158e77074c8 with identifier: EH14183
2026-03-27 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 19:10:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 512b9bb1-156f-5ede-8d04-9158e77074c8 with identifier: EH14183
2026-03-27 19:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 512b9bb1-156f-5ede-8d04-9158e77074c8 with identifier: EH14183 to the API
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:21:25Z',
 'fuel_type': 'petrol',
 'id': '512b9bb1-156f-5ede-8d04-9158e77074c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH14183',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 117116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH14183%27 HTTP/1.1" 200 None
2026-03-27 19:10:21 [auto1.nl] INFO: Saving data for EH14183: {'auction_closing_time': 1774714885.0, 'created_time': 1773134238.438721, 'last_price_update_time': 1774638621.366434}
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH14183') HTTP/1.1" 204 0
2026-03-27 19:10:21 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-27 19:10:21 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-27 19:10:21 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-27 19:10:21 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-27 19:10:21 [auto1.nl] INFO: Scrape type for VD03329: 2
2026-03-27 19:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d72eb42e-28b8-5932-82c1-67dcdac8bb05 with identifier: VD03329
2026-03-27 19:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72eb42e-28b8-5932-82c1-67dcdac8bb05 with scrape type 2
2026-03-27 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d72eb42e-28b8-5932-82c1-67dcdac8bb05 with scrape type 2
2026-03-27 19:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d72eb42e-28b8-5932-82c1-67dcdac8bb05, identifier: VD03329
2026-03-27 19:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d72eb42e-28b8-5932-82c1-67dcdac8bb05 with identifier: VD03329
2026-03-27 19:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d72eb42e-28b8-5932-82c1-67dcdac8bb05 with identifier: VD03329
2026-03-27 19:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d72eb42e-28b8-5932-82c1-67dcdac8bb05 with identifier: VD03329 to the API
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:57:33Z',
 'fuel_type': 'diesel',
 'id': 'd72eb42e-28b8-5932-82c1-67dcdac8bb05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD03329',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 277539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-26',
 'seller_name': None,
 'title': 'Opel Vivaro 2.5 CDTI Kasten L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t',
 'year': 2011}
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-27 19:10:21 [auto1.nl] INFO: Saving data for VD03329: {'auction_closing_time': 1774717053.0, 'created_time': 1773836758.027361, 'last_price_update_time': 1774638621.767442}
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD03329') HTTP/1.1" 204 0
2026-03-27 19:10:21 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-27 19:10:21 [auto1.nl] INFO: Scrape type for WX34396: 2
2026-03-27 19:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396
2026-03-27 19:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with scrape type 2
2026-03-27 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with scrape type 2
2026-03-27 19:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca912cb0-dad5-54f1-afe8-fd69f13b23b9, identifier: WX34396
2026-03-27 19:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 19:10:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396
2026-03-27 19:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396 to the API
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:32:47Z',
 'fuel_type': 'petrol',
 'id': 'ca912cb0-dad5-54f1-afe8-fd69f13b23b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX34396',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 201587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-23',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Saving data for WX34396: {'auction_closing_time': 1774715567.0, 'created_time': 1773132428.349442, 'last_price_update_time': 1774638622.275221}
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WX34396') HTTP/1.1" 204 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ01481%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for PZ01481: 1
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF40574%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for RF40574: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for AA80905: 1
2026-03-27 19:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:22 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for WF02577: 1
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC45761%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for VC45761: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for CT54062: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for RJ64387: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-27 19:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:22 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/PG19961/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for YW05960: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-27 19:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for VX32369: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for YP02517: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for NR59954: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH14183%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for EH14183: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF40574%27 HTTP/1.1" 200 None
2026-03-27 19:10:22 [auto1.nl] INFO: Scrape type for RF40574: 0
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-27 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG19961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:22 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-27 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM65316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF02577/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA80905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:23 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:23 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-27 19:10:23 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-27 19:10:23 [auto1.nl] INFO: Scrape type for TU99712: 1
2026-03-27 19:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:23 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-27 19:10:23 [auto1.nl] INFO: Scrape type for RA23366: 1
2026-03-27 19:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:23 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-27 19:10:23 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-27 19:10:23 [auto1.nl] INFO: Scrape type for UB80121: 1
2026-03-27 19:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:23 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-27 19:10:23 [auto1.nl] INFO: Scrape type for LG71332: 1
2026-03-27 19:10:23 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-27 19:10:23 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-27 19:10:23 [auto1.nl] INFO: Scrape type for JM47469: 2
2026-03-27 19:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469
2026-03-27 19:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da668c5-d576-5a87-9220-bd2dd3339164 with scrape type 2
2026-03-27 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0da668c5-d576-5a87-9220-bd2dd3339164 with scrape type 2
2026-03-27 19:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0da668c5-d576-5a87-9220-bd2dd3339164, identifier: JM47469
2026-03-27 19:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469
2026-03-27 19:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469
2026-03-27 19:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469 to the API
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 270,
 'expiration_date': '2026-03-28T16:43:58Z',
 'fuel_type': 'petrol',
 'id': '0da668c5-d576-5a87-9220-bd2dd3339164',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM47469',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 181452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI R',
 'transmission': 'automatic',
 'trim': 'R',
 'year': 2011}
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-27 19:10:24 [auto1.nl] INFO: Saving data for JM47469: {'auction_closing_time': 1774716238.0, 'created_time': 1773924169.410504, 'last_price_update_time': 1774638624.29543}
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM47469') HTTP/1.1" 204 0
2026-03-27 19:10:24 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-27 19:10:24 [auto1.nl] INFO: Scrape type for BX66014: 1
2026-03-27 19:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG19961> (referer: https://www.auto1.com/v1/car-details-view/PG19961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM65316> (referer: https://www.auto1.com/v1/car-details-view/MM65316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:24 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-27 19:10:24 [auto1.nl] INFO: Scrape type for ME20407: 1
2026-03-27 19:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:24 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-27 19:10:24 [auto1.nl] INFO: Scrape type for SR40415: 1
2026-03-27 19:10:24 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-27 19:10:24 [auto1.nl] INFO: Scrape type for MZ48021: 1
2026-03-27 19:10:24 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-27 19:10:24 [auto1.nl] INFO: Scrape type for VH01672: 2
2026-03-27 19:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672
2026-03-27 19:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with scrape type 2
2026-03-27 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with scrape type 2
2026-03-27 19:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6db109cc-5fc8-5053-8d59-6ac44de9ef03, identifier: VH01672
2026-03-27 19:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672
2026-03-27 19:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672
2026-03-27 19:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672 to the API
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:17:22Z',
 'fuel_type': 'hybrid',
 'id': '6db109cc-5fc8-5053-8d59-6ac44de9ef03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH01672',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 226716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2015}
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-27 19:10:24 [auto1.nl] INFO: Saving data for VH01672: {'auction_closing_time': 1774714642.0, 'created_time': 1773837490.962907, 'last_price_update_time': 1774638624.993883}
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH01672') HTTP/1.1" 204 0
2026-03-27 19:10:25 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [auto1.nl] INFO: Scrape type for FH34143: 1
2026-03-27 19:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF02577> (referer: https://www.auto1.com/v1/car-details-view/WF02577/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dabe6cda-2b86-5824-b9ec-c419fad4c76e with identifier: PG19961
2026-03-27 19:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dabe6cda-2b86-5824-b9ec-c419fad4c76e with scrape type 1
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item dabe6cda-2b86-5824-b9ec-c419fad4c76e
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F2d%252F462d03783395fb61d4e0e1269db2aa28%252Fpa%252FPG19961_e23fb990a9397e512a0272a9653ae38c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_e23fb990a9397e512a0272a9653ae38c.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F2d%252F462d03783395fb61d4e0e1269db2aa28%252Fpa%252FPG19961_a20d646ab709d340f9b5d287d1fc68f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_a20d646ab709d340f9b5d287d1fc68f3.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F2d%252F462d03783395fb61d4e0e1269db2aa28%252Fpa%252FPG19961_4b43db8aa747a37b66137c265d04f064.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_4b43db8aa747a37b66137c265d04f064.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F2d%252F462d03783395fb61d4e0e1269db2aa28%252Fpa%252FPG19961_688b8189660d6f506f3ac244ffa3d8c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_688b8189660d6f506f3ac244ffa3d8c5.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F2d%252F462d03783395fb61d4e0e1269db2aa28%252Fpa%252FPG19961_f9878e8af5033474295f4dd78a134f59.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_f9878e8af5033474295f4dd78a134f59.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F2d%252F462d03783395fb61d4e0e1269db2aa28%252Fpa%252FPG19961_113b9278f3d51e0a25cba3e567bb8944.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_113b9278f3d51e0a25cba3e567bb8944.jpg already downloaded
2026-03-27 19:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dabe6cda-2b86-5824-b9ec-c419fad4c76e, identifier: PG19961
2026-03-27 19:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d2362f-8318-57d5-8787-52a2770984d6 with identifier: MM65316
2026-03-27 19:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d2362f-8318-57d5-8787-52a2770984d6 with scrape type 1
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56d2362f-8318-57d5-8787-52a2770984d6
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_2a81a014cd767c47ad68016843adf815.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_2a81a014cd767c47ad68016843adf815.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_d69e8f9e9ab87b13d3eb2c82fd2a0043.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_d69e8f9e9ab87b13d3eb2c82fd2a0043.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_400b3caa57ed145e5e1920c0db49f8f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_400b3caa57ed145e5e1920c0db49f8f8.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_9ea8c05b3ba1135b6037e4a17b4e87d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_9ea8c05b3ba1135b6037e4a17b4e87d8.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_985e8fc4dec400f95dde546b509378bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_985e8fc4dec400f95dde546b509378bf.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_e2502ca8185603bb86c12b5fbd307443.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_e2502ca8185603bb86c12b5fbd307443.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_4fb6047c5d7d4b4bef6e1db5985288e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_4fb6047c5d7d4b4bef6e1db5985288e5.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_b81287f4a1afd4300b8eb41a5aef6a1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_b81287f4a1afd4300b8eb41a5aef6a1f.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_b1a27f4fa8385cc37b4b8edffdd6fd36.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_b1a27f4fa8385cc37b4b8edffdd6fd36.jpg already downloaded
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fbb%252F5cbbc35deb0dba984d0895157c0ab47d%252Fpa%252FMM65316_dd6efae47ad8b01baeb7427757cf5a6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_dd6efae47ad8b01baeb7427757cf5a6b.jpg already downloaded
2026-03-27 19:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56d2362f-8318-57d5-8787-52a2770984d6, identifier: MM65316
2026-03-27 19:10:25 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS95271%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [auto1.nl] INFO: Scrape type for HS95271: 0
2026-03-27 19:10:25 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [auto1.nl] INFO: Scrape type for YP25238: 0
2026-03-27 19:10:25 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ78328%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [auto1.nl] INFO: Scrape type for PJ78328: 2
2026-03-27 19:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deea1cf7-904d-5e1f-8ea5-9f60e4eba0a1 with identifier: PJ78328
2026-03-27 19:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deea1cf7-904d-5e1f-8ea5-9f60e4eba0a1 with scrape type 2
2026-03-27 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deea1cf7-904d-5e1f-8ea5-9f60e4eba0a1 with scrape type 2
2026-03-27 19:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: deea1cf7-904d-5e1f-8ea5-9f60e4eba0a1, identifier: PJ78328
2026-03-27 19:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA80905> (referer: https://www.auto1.com/v1/car-details-view/AA80905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dabe6cda-2b86-5824-b9ec-c419fad4c76e with identifier: PG19961
2026-03-27 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dabe6cda-2b86-5824-b9ec-c419fad4c76e with identifier: PG19961
2026-03-27 19:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dabe6cda-2b86-5824-b9ec-c419fad4c76e with identifier: PG19961 to the API
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PG19961>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:00:47Z',
 'fuel_type': 'petrol',
 'id': 'dabe6cda-2b86-5824-b9ec-c419fad4c76e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HG601L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG19961',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 157924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_e23fb990a9397e512a0272a9653ae38c.jpg',
                'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_a20d646ab709d340f9b5d287d1fc68f3.jpg',
                'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_4b43db8aa747a37b66137c265d04f064.jpg',
                'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_688b8189660d6f506f3ac244ffa3d8c5.jpg',
                'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_f9878e8af5033474295f4dd78a134f59.jpg',
                'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_113b9278f3d51e0a25cba3e567bb8944.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dabe6cda-2b86-5824-b9ec-c419fad4c76e/dabe6cda-2b86-5824-b9ec-c419fad4c76e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_e23fb990a9397e512a0272a9653ae38c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dabe6cda-2b86-5824-b9ec-c419fad4c76e/dabe6cda-2b86-5824-b9ec-c419fad4c76e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_a20d646ab709d340f9b5d287d1fc68f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dabe6cda-2b86-5824-b9ec-c419fad4c76e/dabe6cda-2b86-5824-b9ec-c419fad4c76e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_4b43db8aa747a37b66137c265d04f064.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dabe6cda-2b86-5824-b9ec-c419fad4c76e/dabe6cda-2b86-5824-b9ec-c419fad4c76e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_688b8189660d6f506f3ac244ffa3d8c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dabe6cda-2b86-5824-b9ec-c419fad4c76e/dabe6cda-2b86-5824-b9ec-c419fad4c76e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_f9878e8af5033474295f4dd78a134f59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dabe6cda-2b86-5824-b9ec-c419fad4c76e/dabe6cda-2b86-5824-b9ec-c419fad4c76e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/2d/462d03783395fb61d4e0e1269db2aa28/pa/PG19961_113b9278f3d51e0a25cba3e567bb8944.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2007}
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG19961%27 HTTP/1.1" 200 None
2026-03-27 19:10:25 [auto1.nl] INFO: Saving data for PG19961: {'created_time': 1774638625.953529, 'last_price_update_time': 1774638625.953543, 'auction_closing_time': 1774713647.0}
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PG19961') HTTP/1.1" 204 0
2026-03-27 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56d2362f-8318-57d5-8787-52a2770984d6 with identifier: MM65316
2026-03-27 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56d2362f-8318-57d5-8787-52a2770984d6 with identifier: MM65316
2026-03-27 19:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56d2362f-8318-57d5-8787-52a2770984d6 with identifier: MM65316 to the API
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MM65316>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:57:19Z',
 'fuel_type': 'petrol',
 'id': '56d2362f-8318-57d5-8787-52a2770984d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XF509N',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM65316',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 220853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_2a81a014cd767c47ad68016843adf815.jpg',
                'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_d69e8f9e9ab87b13d3eb2c82fd2a0043.jpg',
                'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_400b3caa57ed145e5e1920c0db49f8f8.jpg',
                'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_9ea8c05b3ba1135b6037e4a17b4e87d8.jpg',
                'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_985e8fc4dec400f95dde546b509378bf.jpg',
                'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_e2502ca8185603bb86c12b5fbd307443.jpg',
                'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_4fb6047c5d7d4b4bef6e1db5985288e5.jpg',
                'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_b81287f4a1afd4300b8eb41a5aef6a1f.jpg',
                'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_b1a27f4fa8385cc37b4b8edffdd6fd36.jpg',
                'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_dd6efae47ad8b01baeb7427757cf5a6b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_2a81a014cd767c47ad68016843adf815.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_d69e8f9e9ab87b13d3eb2c82fd2a0043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_400b3caa57ed145e5e1920c0db49f8f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_9ea8c05b3ba1135b6037e4a17b4e87d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_985e8fc4dec400f95dde546b509378bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_e2502ca8185603bb86c12b5fbd307443.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_4fb6047c5d7d4b4bef6e1db5985288e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_b81287f4a1afd4300b8eb41a5aef6a1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_b1a27f4fa8385cc37b4b8edffdd6fd36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d2362f-8318-57d5-8787-52a2770984d6/56d2362f-8318-57d5-8787-52a2770984d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/bb/5cbbc35deb0dba984d0895157c0ab47d/pa/MM65316_dd6efae47ad8b01baeb7427757cf5a6b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-27 19:10:26 [auto1.nl] INFO: Saving data for MM65316: {'created_time': 1774638626.264606, 'last_price_update_time': 1774638626.264617, 'auction_closing_time': 1774717039.0}
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MM65316') HTTP/1.1" 204 0
2026-03-27 19:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: deea1cf7-904d-5e1f-8ea5-9f60e4eba0a1 with identifier: PJ78328
2026-03-27 19:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: deea1cf7-904d-5e1f-8ea5-9f60e4eba0a1 with identifier: PJ78328
2026-03-27 19:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: deea1cf7-904d-5e1f-8ea5-9f60e4eba0a1 with identifier: PJ78328 to the API
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:05:55Z',
 'fuel_type': 'diesel',
 'id': 'deea1cf7-904d-5e1f-8ea5-9f60e4eba0a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ78328',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 188353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Cabine Approfondie L1H1 1000 Confort',
 'transmission': 'manual',
 'trim': 'Cabine Approfondie L1H1 1000 Confort',
 'year': 2015}
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ78328%27 HTTP/1.1" 200 None
2026-03-27 19:10:26 [auto1.nl] INFO: Saving data for PJ78328: {'auction_closing_time': 1774713955.0, 'created_time': 1774440630.815741, 'last_price_update_time': 1774638626.589963}
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PJ78328') HTTP/1.1" 204 0
2026-03-27 19:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:26 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-27 19:10:26 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW65068%27 HTTP/1.1" 200 None
2026-03-27 19:10:26 [auto1.nl] INFO: Scrape type for MW65068: 2
2026-03-27 19:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with identifier: MW65068
2026-03-27 19:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with scrape type 2
2026-03-27 19:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with scrape type 2
2026-03-27 19:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3, identifier: MW65068
2026-03-27 19:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA23366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU99712/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with identifier: MW65068
2026-03-27 19:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with identifier: MW65068
2026-03-27 19:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with identifier: MW65068 to the API
2026-03-27 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:05:13Z',
 'fuel_type': 'diesel',
 'id': '96e0ab21-113e-59ef-99aa-7afbfd4ea1a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW65068',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 147823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L1 Komfort Avantage',
 'transmission': 'manual',
 'trim': 'L1 Komfort Avantage',
 'year': 2014}
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW65068%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [auto1.nl] INFO: Saving data for MW65068: {'auction_closing_time': 1774713913.0, 'created_time': 1774033828.20545, 'last_price_update_time': 1774638627.548168}
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW65068') HTTP/1.1" 204 0
2026-03-27 19:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577
2026-03-27 19:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162352ca-fec2-50ef-9de6-4dcec3a559e4 with scrape type 1
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 162352ca-fec2-50ef-9de6-4dcec3a559e4
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_d493ca1f703bc11c67af077ab3b2effa.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_d493ca1f703bc11c67af077ab3b2effa.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_df3d7c9fba6cbb46ba79a0c60c621870.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_df3d7c9fba6cbb46ba79a0c60c621870.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_f19850fe52882fd8ab60af10ddc60f94.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_f19850fe52882fd8ab60af10ddc60f94.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_85548aac31f35b6369b79c88b744fa21.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_85548aac31f35b6369b79c88b744fa21.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_ccbda021d86197f7625f7dc8759aa69f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_ccbda021d86197f7625f7dc8759aa69f.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_3add1dc6f2f9eafde84084f73da31aba.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_3add1dc6f2f9eafde84084f73da31aba.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_4fdc0fca922dcea0c639249a7230b632.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_4fdc0fca922dcea0c639249a7230b632.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_2e91c3c904ad122aca966af06402d355.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_2e91c3c904ad122aca966af06402d355.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_338e05e48e9ba10de5cfd9d0352c38ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_338e05e48e9ba10de5cfd9d0352c38ba.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F51%252F8b515586a2d6081d57e78fdc4c7c4a32%252Fpa%252FWF02577_c3615babfd0cdd950a090725554125fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_c3615babfd0cdd950a090725554125fd.jpg already downloaded
2026-03-27 19:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 162352ca-fec2-50ef-9de6-4dcec3a559e4, identifier: WF02577
2026-03-27 19:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e66780-6b8c-5f40-af1c-304f89569daa with identifier: AA80905
2026-03-27 19:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e66780-6b8c-5f40-af1c-304f89569daa with scrape type 1
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c9e66780-6b8c-5f40-af1c-304f89569daa
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F2b%252Ff62b0a18a85ea56b9414e8d8fba7e8e2%252Fpa%252FAA80905_5df8d0278bcdbed26d80793362c9ad18.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_5df8d0278bcdbed26d80793362c9ad18.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F2b%252Ff62b0a18a85ea56b9414e8d8fba7e8e2%252Fpa%252FAA80905_16ecd508e5b1f56c3301601b78a2d748.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_16ecd508e5b1f56c3301601b78a2d748.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F2b%252Ff62b0a18a85ea56b9414e8d8fba7e8e2%252Fpa%252FAA80905_dff1df81580e253e27e654e7a37b958a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_dff1df81580e253e27e654e7a37b958a.jpg already downloaded
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F2b%252Ff62b0a18a85ea56b9414e8d8fba7e8e2%252Fpa%252FAA80905_aa5f9860da9cf919592beb48110bbef0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_aa5f9860da9cf919592beb48110bbef0.jpg already downloaded
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F2b%252Ff62b0a18a85ea56b9414e8d8fba7e8e2%252Fpa%252FAA80905_c6a2ee72de3bf1d6cd7093a6c2b6fe51.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_c6a2ee72de3bf1d6cd7093a6c2b6fe51.jpg already downloaded
2026-03-27 19:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c9e66780-6b8c-5f40-af1c-304f89569daa, identifier: AA80905
2026-03-27 19:10:28 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB97698%27 HTTP/1.1" 200 None
2026-03-27 19:10:28 [auto1.nl] INFO: Scrape type for KB97698: 0
2026-03-27 19:10:28 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-27 19:10:28 [auto1.nl] INFO: Scrape type for UC91516: 0
2026-03-27 19:10:28 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-27 19:10:28 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU39943%27 HTTP/1.1" 200 None
2026-03-27 19:10:28 [auto1.nl] INFO: Scrape type for LU39943: 2
2026-03-27 19:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d29bc1b9-d726-55d4-a3e4-1f0cdd48e936 with identifier: LU39943
2026-03-27 19:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d29bc1b9-d726-55d4-a3e4-1f0cdd48e936 with scrape type 2
2026-03-27 19:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d29bc1b9-d726-55d4-a3e4-1f0cdd48e936 with scrape type 2
2026-03-27 19:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d29bc1b9-d726-55d4-a3e4-1f0cdd48e936, identifier: LU39943
2026-03-27 19:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577
2026-03-27 19:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577
2026-03-27 19:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577 to the API
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WF02577>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:24:56Z',
 'fuel_type': 'petrol',
 'id': '162352ca-fec2-50ef-9de6-4dcec3a559e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'T-643-VR',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF02577',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 175463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_d493ca1f703bc11c67af077ab3b2effa.jpg',
                'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_df3d7c9fba6cbb46ba79a0c60c621870.jpg',
                'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_f19850fe52882fd8ab60af10ddc60f94.jpg',
                'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_85548aac31f35b6369b79c88b744fa21.jpg',
                'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_ccbda021d86197f7625f7dc8759aa69f.jpg',
                'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_3add1dc6f2f9eafde84084f73da31aba.jpg',
                'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_4fdc0fca922dcea0c639249a7230b632.jpg',
                'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_2e91c3c904ad122aca966af06402d355.jpg',
                'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_338e05e48e9ba10de5cfd9d0352c38ba.jpg',
                'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_c3615babfd0cdd950a090725554125fd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_d493ca1f703bc11c67af077ab3b2effa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_df3d7c9fba6cbb46ba79a0c60c621870.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_f19850fe52882fd8ab60af10ddc60f94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_85548aac31f35b6369b79c88b744fa21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_ccbda021d86197f7625f7dc8759aa69f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_3add1dc6f2f9eafde84084f73da31aba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_4fdc0fca922dcea0c639249a7230b632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_2e91c3c904ad122aca966af06402d355.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_338e05e48e9ba10de5cfd9d0352c38ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162352ca-fec2-50ef-9de6-4dcec3a559e4/162352ca-fec2-50ef-9de6-4dcec3a559e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/51/8b515586a2d6081d57e78fdc4c7c4a32/pa/WF02577_c3615babfd0cdd950a090725554125fd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.6 TCe Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-27 19:10:28 [auto1.nl] INFO: Saving data for WF02577: {'created_time': 1774638628.485381, 'last_price_update_time': 1774638628.48539, 'auction_closing_time': 1774715096.0}
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WF02577') HTTP/1.1" 204 0
2026-03-27 19:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c9e66780-6b8c-5f40-af1c-304f89569daa with identifier: AA80905
2026-03-27 19:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c9e66780-6b8c-5f40-af1c-304f89569daa with identifier: AA80905
2026-03-27 19:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c9e66780-6b8c-5f40-af1c-304f89569daa with identifier: AA80905 to the API
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AA80905>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:55:27Z',
 'fuel_type': 'diesel',
 'id': 'c9e66780-6b8c-5f40-af1c-304f89569daa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '87VTG2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA80905',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 373760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_5df8d0278bcdbed26d80793362c9ad18.jpg',
                'https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_16ecd508e5b1f56c3301601b78a2d748.jpg',
                'https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_dff1df81580e253e27e654e7a37b958a.jpg',
                'https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_aa5f9860da9cf919592beb48110bbef0.jpg',
                'https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_c6a2ee72de3bf1d6cd7093a6c2b6fe51.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e66780-6b8c-5f40-af1c-304f89569daa/c9e66780-6b8c-5f40-af1c-304f89569daa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_5df8d0278bcdbed26d80793362c9ad18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e66780-6b8c-5f40-af1c-304f89569daa/c9e66780-6b8c-5f40-af1c-304f89569daa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_16ecd508e5b1f56c3301601b78a2d748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e66780-6b8c-5f40-af1c-304f89569daa/c9e66780-6b8c-5f40-af1c-304f89569daa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_dff1df81580e253e27e654e7a37b958a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e66780-6b8c-5f40-af1c-304f89569daa/c9e66780-6b8c-5f40-af1c-304f89569daa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_aa5f9860da9cf919592beb48110bbef0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e66780-6b8c-5f40-af1c-304f89569daa/c9e66780-6b8c-5f40-af1c-304f89569daa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/2b/f62b0a18a85ea56b9414e8d8fba7e8e2/pa/AA80905_c6a2ee72de3bf1d6cd7093a6c2b6fe51.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM 12 ELX L2H1 120 Multijet',
 'transmission': 'manual',
 'trim': '12 ELX L2H1 120 Multijet',
 'year': 2008}
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-27 19:10:28 [auto1.nl] INFO: Saving data for AA80905: {'created_time': 1774638628.838401, 'last_price_update_time': 1774638628.838414, 'auction_closing_time': 1774716927.0}
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AA80905') HTTP/1.1" 204 0
2026-03-27 19:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d29bc1b9-d726-55d4-a3e4-1f0cdd48e936 with identifier: LU39943
2026-03-27 19:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d29bc1b9-d726-55d4-a3e4-1f0cdd48e936 with identifier: LU39943
2026-03-27 19:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d29bc1b9-d726-55d4-a3e4-1f0cdd48e936 with identifier: LU39943 to the API
2026-03-27 19:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:15:51Z',
 'fuel_type': 'petrol',
 'id': 'd29bc1b9-d726-55d4-a3e4-1f0cdd48e936',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU39943',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 39194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2021}
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU39943%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Saving data for LU39943: {'auction_closing_time': 1774714551.0, 'created_time': 1773861249.633206, 'last_price_update_time': 1774638629.127768}
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LU39943') HTTP/1.1" 204 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV76653%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for CV76653: 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CZ60443%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for CZ60443: 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54016%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for AB54016: 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for FJ00169: 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WT58034%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for WT58034: 2
2026-03-27 19:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f248bdbd-21b4-5bec-b490-ec067f4f9792 with identifier: WT58034
2026-03-27 19:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f248bdbd-21b4-5bec-b490-ec067f4f9792 with scrape type 2
2026-03-27 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f248bdbd-21b4-5bec-b490-ec067f4f9792 with scrape type 2
2026-03-27 19:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f248bdbd-21b4-5bec-b490-ec067f4f9792, identifier: WT58034
2026-03-27 19:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB80121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f248bdbd-21b4-5bec-b490-ec067f4f9792 with identifier: WT58034
2026-03-27 19:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f248bdbd-21b4-5bec-b490-ec067f4f9792 with identifier: WT58034
2026-03-27 19:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f248bdbd-21b4-5bec-b490-ec067f4f9792 with identifier: WT58034 to the API
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:11:12Z',
 'fuel_type': 'petrol',
 'id': 'f248bdbd-21b4-5bec-b490-ec067f4f9792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT58034',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 95109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-16',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WT58034%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Saving data for WT58034: {'auction_closing_time': 1774714272.0, 'created_time': 1774440657.423756, 'last_price_update_time': 1774638629.663753}
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WT58034') HTTP/1.1" 204 0
2026-03-27 19:10:29 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM03723%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for YM03723: 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR64287%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for TR64287: 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE34975%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for LE34975: 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK53895%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for FK53895: 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX13279%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for JX13279: 0
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-27 19:10:29 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT56594%27 HTTP/1.1" 200 None
2026-03-27 19:10:29 [auto1.nl] INFO: Scrape type for NT56594: 2
2026-03-27 19:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ee581e2-4bca-5ca2-9294-843437acf61b with identifier: NT56594
2026-03-27 19:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ee581e2-4bca-5ca2-9294-843437acf61b with scrape type 2
2026-03-27 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ee581e2-4bca-5ca2-9294-843437acf61b with scrape type 2
2026-03-27 19:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8ee581e2-4bca-5ca2-9294-843437acf61b, identifier: NT56594
2026-03-27 19:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8ee581e2-4bca-5ca2-9294-843437acf61b with identifier: NT56594
2026-03-27 19:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8ee581e2-4bca-5ca2-9294-843437acf61b with identifier: NT56594
2026-03-27 19:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8ee581e2-4bca-5ca2-9294-843437acf61b with identifier: NT56594 to the API
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:14:37Z',
 'fuel_type': 'petrol',
 'id': '8ee581e2-4bca-5ca2-9294-843437acf61b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT56594',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 112564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-11',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Edition+',
 'transmission': 'manual',
 'trim': 'Edition+',
 'year': 2009}
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT56594%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Saving data for NT56594: {'auction_closing_time': 1774714477.0, 'created_time': 1774440625.589511, 'last_price_update_time': 1774638630.333807}
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NT56594') HTTP/1.1" 204 0
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Scrape type for XG57923: 0
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU47491%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Scrape type for FU47491: 0
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL54745%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Scrape type for NL54745: 0
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS22669%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Scrape type for AS22669: 0
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Scrape type for BM26306: 0
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: ZM76247
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Scrape type for MM08239: 0
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS94001%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Scrape type for HS94001: 2
2026-03-27 19:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce2199da-993c-58ed-b036-d1746742f7ec with identifier: HS94001
2026-03-27 19:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2199da-993c-58ed-b036-d1746742f7ec with scrape type 2
2026-03-27 19:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce2199da-993c-58ed-b036-d1746742f7ec with scrape type 2
2026-03-27 19:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ce2199da-993c-58ed-b036-d1746742f7ec, identifier: HS94001
2026-03-27 19:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ce2199da-993c-58ed-b036-d1746742f7ec with identifier: HS94001
2026-03-27 19:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ce2199da-993c-58ed-b036-d1746742f7ec with identifier: HS94001
2026-03-27 19:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ce2199da-993c-58ed-b036-d1746742f7ec with identifier: HS94001 to the API
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:32:29Z',
 'fuel_type': 'petrol',
 'id': 'ce2199da-993c-58ed-b036-d1746742f7ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS94001',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 157119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-29',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS94001%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Saving data for HS94001: {'auction_closing_time': 1774715549.0, 'created_time': 1774440702.644604, 'last_price_update_time': 1774638630.88052}
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HS94001') HTTP/1.1" 204 0
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-27 19:10:30 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL56682%27 HTTP/1.1" 200 None
2026-03-27 19:10:30 [auto1.nl] INFO: Scrape type for BL56682: 2
2026-03-27 19:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f49fbdf-4416-55d7-963d-d66f72278814 with identifier: BL56682
2026-03-27 19:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f49fbdf-4416-55d7-963d-d66f72278814 with scrape type 2
2026-03-27 19:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f49fbdf-4416-55d7-963d-d66f72278814 with scrape type 2
2026-03-27 19:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f49fbdf-4416-55d7-963d-d66f72278814, identifier: BL56682
2026-03-27 19:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f49fbdf-4416-55d7-963d-d66f72278814 with identifier: BL56682
2026-03-27 19:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f49fbdf-4416-55d7-963d-d66f72278814 with identifier: BL56682
2026-03-27 19:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f49fbdf-4416-55d7-963d-d66f72278814 with identifier: BL56682 to the API
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:30:08Z',
 'fuel_type': 'petrol',
 'id': '3f49fbdf-4416-55d7-963d-d66f72278814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL56682',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 228764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-25',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL56682%27 HTTP/1.1" 200 None
2026-03-27 19:10:31 [auto1.nl] INFO: Saving data for BL56682: {'auction_closing_time': 1774715408.0, 'created_time': 1774440666.01257, 'last_price_update_time': 1774638631.630675}
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BL56682') HTTP/1.1" 204 0
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB63862%27 HTTP/1.1" 200 None
2026-03-27 19:10:31 [auto1.nl] INFO: Scrape type for MB63862: 0
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-27 19:10:31 [auto1.nl] INFO: Scrape type for SE84312: 0
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE73396%27 HTTP/1.1" 200 None
2026-03-27 19:10:31 [auto1.nl] INFO: Scrape type for PE73396: 0
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY41827%27 HTTP/1.1" 200 None
2026-03-27 19:10:31 [auto1.nl] INFO: Scrape type for CY41827: 0
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-27 19:10:31 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG22704%27 HTTP/1.1" 200 None
2026-03-27 19:10:31 [auto1.nl] INFO: Scrape type for ZG22704: 2
2026-03-27 19:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87738d86-3b55-5fb2-973b-b6da449cf699 with identifier: ZG22704
2026-03-27 19:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87738d86-3b55-5fb2-973b-b6da449cf699 with scrape type 2
2026-03-27 19:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87738d86-3b55-5fb2-973b-b6da449cf699 with scrape type 2
2026-03-27 19:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 87738d86-3b55-5fb2-973b-b6da449cf699, identifier: ZG22704
2026-03-27 19:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME20407/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG71332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 87738d86-3b55-5fb2-973b-b6da449cf699 with identifier: ZG22704
2026-03-27 19:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 87738d86-3b55-5fb2-973b-b6da449cf699 with identifier: ZG22704
2026-03-27 19:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 87738d86-3b55-5fb2-973b-b6da449cf699 with identifier: ZG22704 to the API
2026-03-27 19:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:41:46Z',
 'fuel_type': 'petrol',
 'id': '87738d86-3b55-5fb2-973b-b6da449cf699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG22704',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 207347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-15',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2015}
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG22704%27 HTTP/1.1" 200 None
2026-03-27 19:10:32 [auto1.nl] INFO: Saving data for ZG22704: {'auction_closing_time': 1774716106.0, 'created_time': 1773302378.931532, 'last_price_update_time': 1774638632.191718}
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG22704') HTTP/1.1" 204 0
2026-03-27 19:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH34143/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ48021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:32 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS09006%27 HTTP/1.1" 200 None
2026-03-27 19:10:32 [auto1.nl] INFO: Scrape type for PS09006: 2
2026-03-27 19:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8c7b324-b366-5904-b142-091fc4fd147e with identifier: PS09006
2026-03-27 19:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8c7b324-b366-5904-b142-091fc4fd147e with scrape type 2
2026-03-27 19:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8c7b324-b366-5904-b142-091fc4fd147e with scrape type 2
2026-03-27 19:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b8c7b324-b366-5904-b142-091fc4fd147e, identifier: PS09006
2026-03-27 19:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR40415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b8c7b324-b366-5904-b142-091fc4fd147e with identifier: PS09006
2026-03-27 19:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b8c7b324-b366-5904-b142-091fc4fd147e with identifier: PS09006
2026-03-27 19:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b8c7b324-b366-5904-b142-091fc4fd147e with identifier: PS09006 to the API
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:50:10Z',
 'fuel_type': 'petrol',
 'id': 'b8c7b324-b366-5904-b142-091fc4fd147e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS09006',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 221808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS09006%27 HTTP/1.1" 200 None
2026-03-27 19:10:32 [auto1.nl] INFO: Saving data for PS09006: {'auction_closing_time': 1774716610.0, 'created_time': 1774440679.741884, 'last_price_update_time': 1774638632.737362}
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PS09006') HTTP/1.1" 204 0
2026-03-27 19:10:32 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-27 19:10:32 [auto1.nl] INFO: Scrape type for KB59261: 0
2026-03-27 19:10:32 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF97973%27 HTTP/1.1" 200 None
2026-03-27 19:10:32 [auto1.nl] INFO: Scrape type for PF97973: 0
2026-03-27 19:10:32 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-27 19:10:32 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-27 19:10:32 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-27 19:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:33 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-27 19:10:33 [auto1.nl] INFO: Scrape type for ZR90330: 0
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG43162%27 HTTP/1.1" 200 None
2026-03-27 19:10:33 [auto1.nl] INFO: Scrape type for YG43162: 0
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY36712%27 HTTP/1.1" 200 None
2026-03-27 19:10:33 [auto1.nl] INFO: Scrape type for MY36712: 0
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT43342%27 HTTP/1.1" 200 None
2026-03-27 19:10:33 [auto1.nl] INFO: Scrape type for DT43342: 0
2026-03-27 19:10:33 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW63639%27 HTTP/1.1" 200 None
2026-03-27 19:10:33 [auto1.nl] INFO: Scrape type for XW63639: 2
2026-03-27 19:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85fb2368-da53-5a87-9774-73213634643a with identifier: XW63639
2026-03-27 19:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85fb2368-da53-5a87-9774-73213634643a with scrape type 2
2026-03-27 19:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85fb2368-da53-5a87-9774-73213634643a with scrape type 2
2026-03-27 19:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 85fb2368-da53-5a87-9774-73213634643a, identifier: XW63639
2026-03-27 19:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 85fb2368-da53-5a87-9774-73213634643a with identifier: XW63639
2026-03-27 19:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 85fb2368-da53-5a87-9774-73213634643a with identifier: XW63639
2026-03-27 19:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 85fb2368-da53-5a87-9774-73213634643a with identifier: XW63639 to the API
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:31:46Z',
 'fuel_type': 'petrol',
 'id': '85fb2368-da53-5a87-9774-73213634643a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW63639',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 146439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-15',
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'M Sport Shadow',
 'year': 2019}
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW63639%27 HTTP/1.1" 200 None
2026-03-27 19:10:33 [auto1.nl] INFO: Saving data for XW63639: {'auction_closing_time': 1774715506.0, 'created_time': 1773688368.315368, 'last_price_update_time': 1774638633.994042}
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW63639') HTTP/1.1" 204 0
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK25507%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [auto1.nl] INFO: Scrape type for MK25507: 2
2026-03-27 19:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb731393-f5ec-59d3-af24-5908e8f46fd7 with identifier: MK25507
2026-03-27 19:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb731393-f5ec-59d3-af24-5908e8f46fd7 with scrape type 2
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb731393-f5ec-59d3-af24-5908e8f46fd7 with scrape type 2
2026-03-27 19:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cb731393-f5ec-59d3-af24-5908e8f46fd7, identifier: MK25507
2026-03-27 19:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cb731393-f5ec-59d3-af24-5908e8f46fd7 with identifier: MK25507
2026-03-27 19:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cb731393-f5ec-59d3-af24-5908e8f46fd7 with identifier: MK25507
2026-03-27 19:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cb731393-f5ec-59d3-af24-5908e8f46fd7 with identifier: MK25507 to the API
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:35Z',
 'fuel_type': 'petrol',
 'id': 'cb731393-f5ec-59d3-af24-5908e8f46fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK25507',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 53617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seller_name': None,
 'title': 'Audi A5 Sportback 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK25507%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [auto1.nl] INFO: Saving data for MK25507: {'auction_closing_time': 1774716455.0, 'created_time': 1773688363.339647, 'last_price_update_time': 1774638634.444743}
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MK25507') HTTP/1.1" 204 0
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT18322%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [auto1.nl] INFO: Scrape type for KT18322: 0
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16632%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [auto1.nl] INFO: Scrape type for LZ16632: 0
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [auto1.nl] INFO: Scrape type for ML63258: 0
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY66252%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [auto1.nl] INFO: Scrape type for GY66252: 0
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD70514%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [auto1.nl] INFO: Scrape type for UD70514: 0
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-27 19:10:34 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-27 19:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU99712> (referer: https://www.auto1.com/v1/car-details-view/TU99712/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA23366> (referer: https://www.auto1.com/v1/car-details-view/RA23366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB80121> (referer: https://www.auto1.com/v1/car-details-view/UB80121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH34143> (referer: https://www.auto1.com/v1/car-details-view/FH34143/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ48021> (referer: https://www.auto1.com/v1/car-details-view/MZ48021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712
2026-03-27 19:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96456424-0567-5400-a6a2-f9b54836aa7f with scrape type 1
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96456424-0567-5400-a6a2-f9b54836aa7f
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_d1d896e5a6fe3c9b8b1fec70b7f5f675.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_d1d896e5a6fe3c9b8b1fec70b7f5f675.jpg already downloaded
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_c842eaeacb1e504365d7f8bde42ddee1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_c842eaeacb1e504365d7f8bde42ddee1.jpg already downloaded
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_75413729c598511ceed5ed81160bc547.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_75413729c598511ceed5ed81160bc547.jpg already downloaded
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_ad10cf13975be5df13a9697292f0b21f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_ad10cf13975be5df13a9697292f0b21f.jpg already downloaded
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_0bbfc661263daad9557b848530151b92.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_0bbfc661263daad9557b848530151b92.jpg already downloaded
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_bb3179bb964c72d844b54ea4e2067228.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_bb3179bb964c72d844b54ea4e2067228.jpg already downloaded
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_9be8c7d4c8f07e11143b04a0e1bb4cfd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_9be8c7d4c8f07e11143b04a0e1bb4cfd.jpg already downloaded
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_9848e76a96bfe4022ca1fd8156a8056a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_9848e76a96bfe4022ca1fd8156a8056a.jpg already downloaded
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_8de050f6c9aa831a76ef40a3967526c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_8de050f6c9aa831a76ef40a3967526c7.jpg already downloaded
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff8%252Fa9f8951b746072ea2b86b9257428f2b7%252Fpa%252FTU99712_0ce00ab0ab958e45e221899cf9d171c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_0ce00ab0ab958e45e221899cf9d171c0.jpg already downloaded
2026-03-27 19:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96456424-0567-5400-a6a2-f9b54836aa7f, identifier: TU99712
2026-03-27 19:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712
2026-03-27 19:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712
2026-03-27 19:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712 to the API
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU99712>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:02:12Z',
 'fuel_type': 'petrol',
 'id': '96456424-0567-5400-a6a2-f9b54836aa7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RK225N',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU99712',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'BMW',
 'model': '3er',
 'odometer': 65577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_d1d896e5a6fe3c9b8b1fec70b7f5f675.jpg',
                'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_c842eaeacb1e504365d7f8bde42ddee1.jpg',
                'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_75413729c598511ceed5ed81160bc547.jpg',
                'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_ad10cf13975be5df13a9697292f0b21f.jpg',
                'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_0bbfc661263daad9557b848530151b92.jpg',
                'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_bb3179bb964c72d844b54ea4e2067228.jpg',
                'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_9be8c7d4c8f07e11143b04a0e1bb4cfd.jpg',
                'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_9848e76a96bfe4022ca1fd8156a8056a.jpg',
                'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_8de050f6c9aa831a76ef40a3967526c7.jpg',
                'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_0ce00ab0ab958e45e221899cf9d171c0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_d1d896e5a6fe3c9b8b1fec70b7f5f675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_c842eaeacb1e504365d7f8bde42ddee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_75413729c598511ceed5ed81160bc547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_ad10cf13975be5df13a9697292f0b21f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_0bbfc661263daad9557b848530151b92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_bb3179bb964c72d844b54ea4e2067228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_9be8c7d4c8f07e11143b04a0e1bb4cfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_9848e76a96bfe4022ca1fd8156a8056a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_8de050f6c9aa831a76ef40a3967526c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96456424-0567-5400-a6a2-f9b54836aa7f/96456424-0567-5400-a6a2-f9b54836aa7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f8/a9f8951b746072ea2b86b9257428f2b7/pa/TU99712_0ce00ab0ab958e45e221899cf9d171c0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330i GT xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2017}
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [auto1.nl] INFO: Saving data for TU99712: {'created_time': 1774638635.201322, 'last_price_update_time': 1774638635.201331, 'auction_closing_time': 1774713732.0}
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU99712') HTTP/1.1" 204 0
2026-03-27 19:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG71332> (referer: https://www.auto1.com/v1/car-details-view/LG71332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with identifier: RA23366
2026-03-27 19:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with scrape type 1
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dcde52df-4bb4-551d-b4c2-2b922cfa5b8e
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F8f%252Fb58f7d1e9b0f4e74ba13883412932a7d%252Fpa%252FRA23366_055fb7f39d1aa5fffe4e0cc545809381.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_055fb7f39d1aa5fffe4e0cc545809381.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F8f%252Fb58f7d1e9b0f4e74ba13883412932a7d%252Fpa%252FRA23366_8d63b661c0d5ebaee54773758eed2592.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_8d63b661c0d5ebaee54773758eed2592.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F8f%252Fb58f7d1e9b0f4e74ba13883412932a7d%252Fpa%252FRA23366_2c404b02ddf14e7b07330c992fe5ef2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_2c404b02ddf14e7b07330c992fe5ef2e.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F8f%252Fb58f7d1e9b0f4e74ba13883412932a7d%252Fpa%252FRA23366_526903e33abf02a15b2d1f5bd1fba408.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_526903e33abf02a15b2d1f5bd1fba408.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F8f%252Fb58f7d1e9b0f4e74ba13883412932a7d%252Fpa%252FRA23366_dd4a230de446a4e602d4f92bf8eeb32a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_dd4a230de446a4e602d4f92bf8eeb32a.jpg already downloaded
2026-03-27 19:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e, identifier: RA23366
2026-03-27 19:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121
2026-03-27 19:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a4ad5d-7d22-5014-b2dd-f17c86036076 with scrape type 1
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 11a4ad5d-7d22-5014-b2dd-f17c86036076
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F48%252Fdb4877524e8553d0d68f0a18da8aeaac%252Fpa%252FUB80121_cefe812caa18054b18a4990a386fe12a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_cefe812caa18054b18a4990a386fe12a.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F48%252Fdb4877524e8553d0d68f0a18da8aeaac%252Fpa%252FUB80121_6e1162d87a36897acae616559029f775.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_6e1162d87a36897acae616559029f775.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F48%252Fdb4877524e8553d0d68f0a18da8aeaac%252Fpa%252FUB80121_0605c34e2ca195233ef597d529f29a1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_0605c34e2ca195233ef597d529f29a1d.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F48%252Fdb4877524e8553d0d68f0a18da8aeaac%252Fpa%252FUB80121_0642ef13c26ce8e45d555c2f2d2e29cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_0642ef13c26ce8e45d555c2f2d2e29cb.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F48%252Fdb4877524e8553d0d68f0a18da8aeaac%252Fpa%252FUB80121_603e7bc873210afce960faa76644fb68.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_603e7bc873210afce960faa76644fb68.jpg already downloaded
2026-03-27 19:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 11a4ad5d-7d22-5014-b2dd-f17c86036076, identifier: UB80121
2026-03-27 19:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cd15db4-78ce-5830-b708-07165c5c9b05 with identifier: FH34143
2026-03-27 19:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cd15db4-78ce-5830-b708-07165c5c9b05 with scrape type 1
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9cd15db4-78ce-5830-b708-07165c5c9b05
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_9e439d61decb880ace29f1b43da43bef.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_9e439d61decb880ace29f1b43da43bef.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_b9a38ee13ec88bd72f9329d8e9bd4a39.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_b9a38ee13ec88bd72f9329d8e9bd4a39.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_f197ddd3e338d6e8737017e559573901.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_f197ddd3e338d6e8737017e559573901.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_9e06ff619532934898ef0b9bc5b025b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_9e06ff619532934898ef0b9bc5b025b7.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_8d5258dc613a55a4779bf2a986fc14ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_8d5258dc613a55a4779bf2a986fc14ad.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_1c1f29dc1017e9b92a1c768763ef7605.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_1c1f29dc1017e9b92a1c768763ef7605.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_2fe2669d894e6330ae3db53bf97c75a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_2fe2669d894e6330ae3db53bf97c75a2.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_5eec0a6262c2ad3f9d07eb0bd35a4ce3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_5eec0a6262c2ad3f9d07eb0bd35a4ce3.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_e29b6dac05ce6ce630a8cf2b11409d7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_e29b6dac05ce6ce630a8cf2b11409d7f.jpg already downloaded
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc9%252F60c9e772a3cb27b3897baae1aa452ad3%252Fpa%252FFH34143_e2f529c801dfc7153c7a40e57d08d042.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_e2f529c801dfc7153c7a40e57d08d042.jpg already downloaded
2026-03-27 19:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9cd15db4-78ce-5830-b708-07165c5c9b05, identifier: FH34143
2026-03-27 19:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91678a1-1303-5772-b759-08a4a52d4674 with identifier: MZ48021
2026-03-27 19:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91678a1-1303-5772-b759-08a4a52d4674 with scrape type 1
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_d39e776b74ea2f525d6ffd02e4f49deb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_d39e776b74ea2f525d6ffd02e4f49deb.jpg not downloaded yet
2026-03-27 19:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with identifier: RA23366
2026-03-27 19:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with identifier: RA23366
2026-03-27 19:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with identifier: RA23366 to the API
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA23366>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:45:57Z',
 'fuel_type': 'petrol',
 'id': 'dcde52df-4bb4-551d-b4c2-2b922cfa5b8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '4XSR09',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA23366',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 246599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_055fb7f39d1aa5fffe4e0cc545809381.jpg',
                'https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_8d63b661c0d5ebaee54773758eed2592.jpg',
                'https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_2c404b02ddf14e7b07330c992fe5ef2e.jpg',
                'https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_526903e33abf02a15b2d1f5bd1fba408.jpg',
                'https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_dd4a230de446a4e602d4f92bf8eeb32a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcde52df-4bb4-551d-b4c2-2b922cfa5b8e/dcde52df-4bb4-551d-b4c2-2b922cfa5b8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_055fb7f39d1aa5fffe4e0cc545809381.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcde52df-4bb4-551d-b4c2-2b922cfa5b8e/dcde52df-4bb4-551d-b4c2-2b922cfa5b8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_8d63b661c0d5ebaee54773758eed2592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcde52df-4bb4-551d-b4c2-2b922cfa5b8e/dcde52df-4bb4-551d-b4c2-2b922cfa5b8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_2c404b02ddf14e7b07330c992fe5ef2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcde52df-4bb4-551d-b4c2-2b922cfa5b8e/dcde52df-4bb4-551d-b4c2-2b922cfa5b8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_526903e33abf02a15b2d1f5bd1fba408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcde52df-4bb4-551d-b4c2-2b922cfa5b8e/dcde52df-4bb4-551d-b4c2-2b922cfa5b8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/8f/b58f7d1e9b0f4e74ba13883412932a7d/pa/RA23366_dd4a230de446a4e602d4f92bf8eeb32a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [auto1.nl] INFO: Saving data for RA23366: {'created_time': 1774638636.218891, 'last_price_update_time': 1774638636.2189, 'auction_closing_time': 1774716357.0}
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RA23366') HTTP/1.1" 204 0
2026-03-27 19:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121
2026-03-27 19:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121
2026-03-27 19:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121 to the API
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB80121>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:22:53Z',
 'fuel_type': 'petrol',
 'id': '11a4ad5d-7d22-5014-b2dd-f17c86036076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '51TXVP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB80121',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 63622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_cefe812caa18054b18a4990a386fe12a.jpg',
                'https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_6e1162d87a36897acae616559029f775.jpg',
                'https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_0605c34e2ca195233ef597d529f29a1d.jpg',
                'https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_0642ef13c26ce8e45d555c2f2d2e29cb.jpg',
                'https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_603e7bc873210afce960faa76644fb68.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a4ad5d-7d22-5014-b2dd-f17c86036076/11a4ad5d-7d22-5014-b2dd-f17c86036076_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_cefe812caa18054b18a4990a386fe12a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a4ad5d-7d22-5014-b2dd-f17c86036076/11a4ad5d-7d22-5014-b2dd-f17c86036076_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_6e1162d87a36897acae616559029f775.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a4ad5d-7d22-5014-b2dd-f17c86036076/11a4ad5d-7d22-5014-b2dd-f17c86036076_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_0605c34e2ca195233ef597d529f29a1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a4ad5d-7d22-5014-b2dd-f17c86036076/11a4ad5d-7d22-5014-b2dd-f17c86036076_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_0642ef13c26ce8e45d555c2f2d2e29cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a4ad5d-7d22-5014-b2dd-f17c86036076/11a4ad5d-7d22-5014-b2dd-f17c86036076_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/48/db4877524e8553d0d68f0a18da8aeaac/pa/UB80121_603e7bc873210afce960faa76644fb68.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Avantage',
 'transmission': 'manual',
 'trim': 'Avantage',
 'year': 2005}
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [auto1.nl] INFO: Saving data for UB80121: {'created_time': 1774638636.487429, 'last_price_update_time': 1774638636.487441, 'auction_closing_time': 1774714973.0}
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB80121') HTTP/1.1" 204 0
2026-03-27 19:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9cd15db4-78ce-5830-b708-07165c5c9b05 with identifier: FH34143
2026-03-27 19:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9cd15db4-78ce-5830-b708-07165c5c9b05 with identifier: FH34143
2026-03-27 19:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9cd15db4-78ce-5830-b708-07165c5c9b05 with identifier: FH34143 to the API
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FH34143>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:33:14Z',
 'fuel_type': 'petrol',
 'id': '9cd15db4-78ce-5830-b708-07165c5c9b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZS506N',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH34143',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'BMW',
 'model': '2er',
 'odometer': 132652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_9e439d61decb880ace29f1b43da43bef.jpg',
                'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_b9a38ee13ec88bd72f9329d8e9bd4a39.jpg',
                'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_f197ddd3e338d6e8737017e559573901.jpg',
                'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_9e06ff619532934898ef0b9bc5b025b7.jpg',
                'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_8d5258dc613a55a4779bf2a986fc14ad.jpg',
                'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_1c1f29dc1017e9b92a1c768763ef7605.jpg',
                'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_2fe2669d894e6330ae3db53bf97c75a2.jpg',
                'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_5eec0a6262c2ad3f9d07eb0bd35a4ce3.jpg',
                'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_e29b6dac05ce6ce630a8cf2b11409d7f.jpg',
                'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_e2f529c801dfc7153c7a40e57d08d042.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_9e439d61decb880ace29f1b43da43bef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_b9a38ee13ec88bd72f9329d8e9bd4a39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_f197ddd3e338d6e8737017e559573901.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_9e06ff619532934898ef0b9bc5b025b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_8d5258dc613a55a4779bf2a986fc14ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_1c1f29dc1017e9b92a1c768763ef7605.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_2fe2669d894e6330ae3db53bf97c75a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_5eec0a6262c2ad3f9d07eb0bd35a4ce3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_e29b6dac05ce6ce630a8cf2b11409d7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd15db4-78ce-5830-b708-07165c5c9b05/9cd15db4-78ce-5830-b708-07165c5c9b05_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c9/60c9e772a3cb27b3897baae1aa452ad3/pa/FH34143_e2f529c801dfc7153c7a40e57d08d042.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 225i Active Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [auto1.nl] INFO: Saving data for FH34143: {'created_time': 1774638636.763636, 'last_price_update_time': 1774638636.763646, 'auction_closing_time': 1774715594.0}
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH34143') HTTP/1.1" 204 0
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_f2b003e376ae434a9bdb0ad9a2b450df.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_f2b003e376ae434a9bdb0ad9a2b450df.jpg not downloaded yet
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_947f446442cd74be8b9b07655090ba4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_947f446442cd74be8b9b07655090ba4a.jpg not downloaded yet
2026-03-27 19:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332
2026-03-27 19:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with scrape type 1
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_b636547b3025e327c09595290f3840c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_b636547b3025e327c09595290f3840c2.jpg not downloaded yet
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_9cec48b16aa6b219eecfbaafa5bf7006.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_9cec48b16aa6b219eecfbaafa5bf7006.jpg not downloaded yet
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_7a37e8be2aed88f59cf17b7cf3a01066.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_7a37e8be2aed88f59cf17b7cf3a01066.jpg not downloaded yet
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_3724c28c25e228636f3c4506dabd1386.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_3724c28c25e228636f3c4506dabd1386.jpg not downloaded yet
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_e599be46c21766bd85aa48eca5236643.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_e599be46c21766bd85aa48eca5236643.jpg not downloaded yet
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_9d7a94761d610cfc17ac19af1da89638.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_9d7a94761d610cfc17ac19af1da89638.jpg not downloaded yet
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_5c5042f6727dfb36d1f08053633f44f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_5c5042f6727dfb36d1f08053633f44f8.jpg not downloaded yet
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_b550c2c2ff4d14e6b511c1caaaef5cb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_b550c2c2ff4d14e6b511c1caaaef5cb2.jpg not downloaded yet
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_a2ca75f3a8f6eaf50e2c19b3533c6f40.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_a2ca75f3a8f6eaf50e2c19b3533c6f40.jpg not downloaded yet
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_5000744981a9dfe3b14ca4069cfcb662.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_5000744981a9dfe3b14ca4069cfcb662.jpg not downloaded yet
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_6b7cefe8bcc48247072e83ddbb29e821.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_6b7cefe8bcc48247072e83ddbb29e821.jpg not downloaded yet
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_a76618cf54bdba9ecc41fe5b33fd8628.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_a76618cf54bdba9ecc41fe5b33fd8628.jpg not downloaded yet
2026-03-27 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_b636547b3025e327c09595290f3840c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_7a37e8be2aed88f59cf17b7cf3a01066.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_e599be46c21766bd85aa48eca5236643.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_947f446442cd74be8b9b07655090ba4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_d39e776b74ea2f525d6ffd02e4f49deb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3311310>
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_b636547b3025e327c09595290f3840c2.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_b636547b3025e327c09595290f3840c2.jpg saved to cache
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d
2026-03-27 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_5c5042f6727dfb36d1f08053633f44f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR40415> (referer: https://www.auto1.com/v1/car-details-view/SR40415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33b8510>
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_7a37e8be2aed88f59cf17b7cf3a01066.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_7a37e8be2aed88f59cf17b7cf3a01066.jpg saved to cache
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b25d0>
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_e599be46c21766bd85aa48eca5236643.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_e599be46c21766bd85aa48eca5236643.jpg saved to cache
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d
2026-03-27 19:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b9ad0>
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_947f446442cd74be8b9b07655090ba4a.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_947f446442cd74be8b9b07655090ba4a.jpg saved to cache
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9380410>
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_d39e776b74ea2f525d6ffd02e4f49deb.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_d39e776b74ea2f525d6ffd02e4f49deb.jpg saved to cache
2026-03-27 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME20407> (referer: https://www.auto1.com/v1/car-details-view/ME20407/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33f5b10>
2026-03-27 19:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_5c5042f6727dfb36d1f08053633f44f8.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_5c5042f6727dfb36d1f08053633f44f8.jpg saved to cache
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d
2026-03-27 19:10:38 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3c6587-1162-5844-87ae-90104e8d392d with identifier: SR40415
2026-03-27 19:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3c6587-1162-5844-87ae-90104e8d392d with scrape type 1
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de3c6587-1162-5844-87ae-90104e8d392d
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_86b284fb106171bf6293fb99ac9d022d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_86b284fb106171bf6293fb99ac9d022d.jpg already downloaded
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_7b340262ddffed294b3da6e4ce78ff23.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_7b340262ddffed294b3da6e4ce78ff23.jpg already downloaded
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_19dc6c3ec6a31006441c01d1478cc198.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_19dc6c3ec6a31006441c01d1478cc198.jpg already downloaded
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_2b6e1eac3110c501d55f6863c8f93cfb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_2b6e1eac3110c501d55f6863c8f93cfb.jpg already downloaded
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_98599bc54b38f7bcdca00ef46c23212e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_98599bc54b38f7bcdca00ef46c23212e.jpg already downloaded
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_85415045b242fa491350feebffe66de3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_85415045b242fa491350feebffe66de3.jpg already downloaded
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_09751027299fa4dd50a0a0a132ecd8d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_09751027299fa4dd50a0a0a132ecd8d1.jpg already downloaded
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_cdf51692ddd35f0cff5e5f0040e74994.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_cdf51692ddd35f0cff5e5f0040e74994.jpg already downloaded
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_0b78273cc6dbcd87d7986193acc07004.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_0b78273cc6dbcd87d7986193acc07004.jpg already downloaded
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fac%252F71ac10563fac55d290222b6c55f09bdf%252Fpa%252FSR40415_2fdc5ff4b5ef669aa021d404cd5d8b4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_2fdc5ff4b5ef669aa021d404cd5d8b4b.jpg already downloaded
2026-03-27 19:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: de3c6587-1162-5844-87ae-90104e8d392d, identifier: SR40415
2026-03-27 19:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: de3c6587-1162-5844-87ae-90104e8d392d with identifier: SR40415
2026-03-27 19:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: de3c6587-1162-5844-87ae-90104e8d392d with identifier: SR40415
2026-03-27 19:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: de3c6587-1162-5844-87ae-90104e8d392d with identifier: SR40415 to the API
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR40415>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:37:20Z',
 'fuel_type': 'petrol',
 'id': 'de3c6587-1162-5844-87ae-90104e8d392d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RF297D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR40415',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 108978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_86b284fb106171bf6293fb99ac9d022d.jpg',
                'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_7b340262ddffed294b3da6e4ce78ff23.jpg',
                'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_19dc6c3ec6a31006441c01d1478cc198.jpg',
                'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_2b6e1eac3110c501d55f6863c8f93cfb.jpg',
                'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_98599bc54b38f7bcdca00ef46c23212e.jpg',
                'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_85415045b242fa491350feebffe66de3.jpg',
                'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_09751027299fa4dd50a0a0a132ecd8d1.jpg',
                'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_cdf51692ddd35f0cff5e5f0040e74994.jpg',
                'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_0b78273cc6dbcd87d7986193acc07004.jpg',
                'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_2fdc5ff4b5ef669aa021d404cd5d8b4b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_86b284fb106171bf6293fb99ac9d022d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_7b340262ddffed294b3da6e4ce78ff23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_19dc6c3ec6a31006441c01d1478cc198.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_2b6e1eac3110c501d55f6863c8f93cfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_98599bc54b38f7bcdca00ef46c23212e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_85415045b242fa491350feebffe66de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_09751027299fa4dd50a0a0a132ecd8d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2666572,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_cdf51692ddd35f0cff5e5f0040e74994.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_0b78273cc6dbcd87d7986193acc07004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c6587-1162-5844-87ae-90104e8d392d/de3c6587-1162-5844-87ae-90104e8d392d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ac/71ac10563fac55d290222b6c55f09bdf/pa/SR40415_2fdc5ff4b5ef669aa021d404cd5d8b4b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2013}
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [auto1.nl] INFO: Saving data for SR40415: {'created_time': 1774638638.757295, 'last_price_update_time': 1774638638.757305, 'auction_closing_time': 1774715840.0}
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SR40415') HTTP/1.1" 204 0
2026-03-27 19:10:38 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [auto1.nl] INFO: Scrape type for DS36560: 0
2026-03-27 19:10:38 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-27 19:10:38 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [auto1.nl] INFO: Scrape type for SM80467: 0
2026-03-27 19:10:38 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-27 19:10:38 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW85240%27 HTTP/1.1" 200 None
2026-03-27 19:10:38 [auto1.nl] INFO: Scrape type for EW85240: 2
2026-03-27 19:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with identifier: EW85240
2026-03-27 19:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with scrape type 2
2026-03-27 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with scrape type 2
2026-03-27 19:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab, identifier: EW85240
2026-03-27 19:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with identifier: EW85240
2026-03-27 19:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with identifier: EW85240
2026-03-27 19:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with identifier: EW85240 to the API
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:58:55Z',
 'fuel_type': 'petrol',
 'id': '5f8a5375-abfa-5bf9-8d89-4186d7b8afab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW85240',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 134184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-08',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT Pack',
 'transmission': 'manual',
 'trim': 'GT Pack',
 'year': 2021}
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW85240%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [auto1.nl] INFO: Saving data for EW85240: {'auction_closing_time': 1774717135.0, 'created_time': 1773232182.389484, 'last_price_update_time': 1774638639.196046}
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EW85240') HTTP/1.1" 204 0
2026-03-27 19:10:39 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-27 19:10:39 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [auto1.nl] INFO: Scrape type for GY89787: 0
2026-03-27 19:10:39 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX12849%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [auto1.nl] INFO: Scrape type for EX12849: 0
2026-03-27 19:10:39 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [auto1.nl] INFO: Scrape type for CH10226: 0
2026-03-27 19:10:39 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [auto1.nl] INFO: Scrape type for VL07732: 0
2026-03-27 19:10:39 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-27 19:10:39 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [auto1.nl] INFO: Scrape type for ZR54060: 0
2026-03-27 19:10:39 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH30413%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [auto1.nl] INFO: Scrape type for TH30413: 2
2026-03-27 19:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eac5bdeb-f854-58d3-984a-7e744a2a67d5 with identifier: TH30413
2026-03-27 19:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eac5bdeb-f854-58d3-984a-7e744a2a67d5 with scrape type 2
2026-03-27 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eac5bdeb-f854-58d3-984a-7e744a2a67d5 with scrape type 2
2026-03-27 19:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eac5bdeb-f854-58d3-984a-7e744a2a67d5, identifier: TH30413
2026-03-27 19:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eac5bdeb-f854-58d3-984a-7e744a2a67d5 with identifier: TH30413
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 19:10:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eac5bdeb-f854-58d3-984a-7e744a2a67d5 with identifier: TH30413
2026-03-27 19:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eac5bdeb-f854-58d3-984a-7e744a2a67d5 with identifier: TH30413 to the API
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:59:18Z',
 'fuel_type': 'petrol',
 'id': 'eac5bdeb-f854-58d3-984a-7e744a2a67d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH30413',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 103811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-26',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 Basis +',
 'transmission': 'manual',
 'trim': 'Basis +',
 'year': 2011}
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH30413%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [auto1.nl] INFO: Saving data for TH30413: {'auction_closing_time': 1774717158.0, 'created_time': 1774440703.840847, 'last_price_update_time': 1774638639.766785}
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TH30413') HTTP/1.1" 204 0
2026-03-27 19:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407
2026-03-27 19:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add5493e-b129-5b80-afd7-0ec6d0d838c9 with scrape type 1
2026-03-27 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item add5493e-b129-5b80-afd7-0ec6d0d838c9
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_47db34f810cb9c07539b5305d56b09fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_47db34f810cb9c07539b5305d56b09fb.jpg already downloaded
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_f9b993b71e0d5fca84cf6181e3acb881.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_f9b993b71e0d5fca84cf6181e3acb881.jpg already downloaded
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_f8c3fe7cdff4d610de53af14e47412c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_f8c3fe7cdff4d610de53af14e47412c1.jpg already downloaded
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_5a3a3d849fadfc15ca31c12bcc63ec54.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_5a3a3d849fadfc15ca31c12bcc63ec54.jpg already downloaded
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_935ec6a678594dab77620957b68cbc97.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_935ec6a678594dab77620957b68cbc97.jpg already downloaded
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_07476a21023bbabd1836b47595138eb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_07476a21023bbabd1836b47595138eb3.jpg already downloaded
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_6ed010b778c6528cc9216851d809493c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_6ed010b778c6528cc9216851d809493c.jpg already downloaded
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_cdafd36ca2829482bc7f61fb51f3e30d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_cdafd36ca2829482bc7f61fb51f3e30d.jpg already downloaded
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_6af1e6a8d798ec644d78f9201d78d50a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_6af1e6a8d798ec644d78f9201d78d50a.jpg already downloaded
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F42%252F0f42ff191ae5f791ac3d79780998fc1e%252Fpa%252FME20407_aabc1e94860b4277ab6cdfcf21d477f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_aabc1e94860b4277ab6cdfcf21d477f3.jpg already downloaded
2026-03-27 19:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: add5493e-b129-5b80-afd7-0ec6d0d838c9, identifier: ME20407
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LB35433%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for LB35433: 0
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV30454%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for EV30454: 0
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW15981%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for AW15981: 0
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for DW43709: 0
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM68781%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for AM68781: 0
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU55364%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for MU55364: 0
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV96248%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for PV96248: 0
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for BC50110: 0
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV45583%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for VV45583: 0
2026-03-27 19:10:40 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02438%27 HTTP/1.1" 200 None
2026-03-27 19:10:40 [auto1.nl] INFO: Scrape type for WF02438: 2
2026-03-27 19:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b93c8692-295a-547b-8f38-c387ea0ef934 with identifier: WF02438
2026-03-27 19:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b93c8692-295a-547b-8f38-c387ea0ef934 with scrape type 2
2026-03-27 19:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b93c8692-295a-547b-8f38-c387ea0ef934 with scrape type 2
2026-03-27 19:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b93c8692-295a-547b-8f38-c387ea0ef934, identifier: WF02438
2026-03-27 19:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ01481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407
2026-03-27 19:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407
2026-03-27 19:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407 to the API
2026-03-27 19:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ME20407>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 239,
 'expiration_date': '2026-03-28T16:12:55Z',
 'fuel_type': 'hybrid',
 'id': 'add5493e-b129-5b80-afd7-0ec6d0d838c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R-196-NJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME20407',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 57060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_47db34f810cb9c07539b5305d56b09fb.jpg',
                'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_f9b993b71e0d5fca84cf6181e3acb881.jpg',
                'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_f8c3fe7cdff4d610de53af14e47412c1.jpg',
                'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_5a3a3d849fadfc15ca31c12bcc63ec54.jpg',
                'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_935ec6a678594dab77620957b68cbc97.jpg',
                'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_07476a21023bbabd1836b47595138eb3.jpg',
                'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_6ed010b778c6528cc9216851d809493c.jpg',
                'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_cdafd36ca2829482bc7f61fb51f3e30d.jpg',
                'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_6af1e6a8d798ec644d78f9201d78d50a.jpg',
                'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_aabc1e94860b4277ab6cdfcf21d477f3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_47db34f810cb9c07539b5305d56b09fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_f9b993b71e0d5fca84cf6181e3acb881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_f8c3fe7cdff4d610de53af14e47412c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_5a3a3d849fadfc15ca31c12bcc63ec54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3272904,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_935ec6a678594dab77620957b68cbc97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_07476a21023bbabd1836b47595138eb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_6ed010b778c6528cc9216851d809493c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_cdafd36ca2829482bc7f61fb51f3e30d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_6af1e6a8d798ec644d78f9201d78d50a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add5493e-b129-5b80-afd7-0ec6d0d838c9/add5493e-b129-5b80-afd7-0ec6d0d838c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/42/0f42ff191ae5f791ac3d79780998fc1e/pa/ME20407_aabc1e94860b4277ab6cdfcf21d477f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2022}
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-27 19:10:41 [auto1.nl] INFO: Saving data for ME20407: {'created_time': 1774638641.528342, 'last_price_update_time': 1774638641.528352, 'auction_closing_time': 1774714375.0}
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME20407') HTTP/1.1" 204 0
2026-03-27 19:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b93c8692-295a-547b-8f38-c387ea0ef934 with identifier: WF02438
2026-03-27 19:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b93c8692-295a-547b-8f38-c387ea0ef934 with identifier: WF02438
2026-03-27 19:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b93c8692-295a-547b-8f38-c387ea0ef934 with identifier: WF02438 to the API
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:28:55Z',
 'fuel_type': 'petrol',
 'id': 'b93c8692-295a-547b-8f38-c387ea0ef934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF02438',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 180723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-03',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2015}
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02438%27 HTTP/1.1" 200 None
2026-03-27 19:10:41 [auto1.nl] INFO: Saving data for WF02438: {'auction_closing_time': 1774715335.0, 'created_time': 1774440644.768789, 'last_price_update_time': 1774638641.907773}
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WF02438') HTTP/1.1" 204 0
2026-03-27 19:10:41 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-27 19:10:41 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-27 19:10:41 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX16781%27 HTTP/1.1" 200 None
2026-03-27 19:10:41 [auto1.nl] INFO: Scrape type for RX16781: 0
2026-03-27 19:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX66014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_3724c28c25e228636f3c4506dabd1386.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_9d7a94761d610cfc17ac19af1da89638.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_6b7cefe8bcc48247072e83ddbb29e821.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_b550c2c2ff4d14e6b511c1caaaef5cb2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_9cec48b16aa6b219eecfbaafa5bf7006.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_a76618cf54bdba9ecc41fe5b33fd8628.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_f2b003e376ae434a9bdb0ad9a2b450df.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_5000744981a9dfe3b14ca4069cfcb662.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_a2ca75f3a8f6eaf50e2c19b3533c6f40.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae333ead0>
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_3724c28c25e228636f3c4506dabd1386.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_3724c28c25e228636f3c4506dabd1386.jpg saved to cache
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae337ae90>
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_9d7a94761d610cfc17ac19af1da89638.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_9d7a94761d610cfc17ac19af1da89638.jpg saved to cache
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34ba2d0>
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_6b7cefe8bcc48247072e83ddbb29e821.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_6b7cefe8bcc48247072e83ddbb29e821.jpg saved to cache
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2913290>
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_b550c2c2ff4d14e6b511c1caaaef5cb2.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_b550c2c2ff4d14e6b511c1caaaef5cb2.jpg saved to cache
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2913e90>
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_9cec48b16aa6b219eecfbaafa5bf7006.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_9cec48b16aa6b219eecfbaafa5bf7006.jpg saved to cache
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29160d0>
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_a76618cf54bdba9ecc41fe5b33fd8628.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_a76618cf54bdba9ecc41fe5b33fd8628.jpg saved to cache
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b9390>
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_f2b003e376ae434a9bdb0ad9a2b450df.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_f2b003e376ae434a9bdb0ad9a2b450df.jpg saved to cache
2026-03-27 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2915b50>
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F44%252Fc2443538e0609bbadc05fece26286ef6%252Fpa%252FMZ48021_5000744981a9dfe3b14ca4069cfcb662.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_5000744981a9dfe3b14ca4069cfcb662.jpg saved to cache
2026-03-27 19:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a91678a1-1303-5772-b759-08a4a52d4674
2026-03-27 19:10:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a91678a1-1303-5772-b759-08a4a52d4674, skipping ID generation
2026-03-27 19:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91678a1-1303-5772-b759-08a4a52d4674 with scrape type 1
2026-03-27 19:10:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a91678a1-1303-5772-b759-08a4a52d4674 sending to next pipeline
2026-03-27 19:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a91678a1-1303-5772-b759-08a4a52d4674, identifier: MZ48021
2026-03-27 19:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae338b350>
2026-03-27 19:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fe1%252F20e1e5baa71d67e211ee72ff67d2557f%252Fpa%252FLG71332_a2ca75f3a8f6eaf50e2c19b3533c6f40.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_a2ca75f3a8f6eaf50e2c19b3533c6f40.jpg saved to cache
2026-03-27 19:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d
2026-03-27 19:10:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d, skipping ID generation
2026-03-27 19:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with scrape type 1
2026-03-27 19:10:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d sending to next pipeline
2026-03-27 19:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d, identifier: LG71332
2026-03-27 19:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a91678a1-1303-5772-b759-08a4a52d4674 with identifier: MZ48021
2026-03-27 19:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a91678a1-1303-5772-b759-08a4a52d4674 with identifier: MZ48021
2026-03-27 19:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a91678a1-1303-5772-b759-08a4a52d4674 with identifier: MZ48021 to the API
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_5000744981a9dfe3b14ca4069cfcb662.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:49:17Z',
 'fuel_type': 'petrol',
 'id': 'a91678a1-1303-5772-b759-08a4a52d4674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H249SB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ48021',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 103859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2588659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_d39e776b74ea2f525d6ffd02e4f49deb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_f2b003e376ae434a9bdb0ad9a2b450df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2770895,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_947f446442cd74be8b9b07655090ba4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2983405,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_9cec48b16aa6b219eecfbaafa5bf7006.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855520,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_3724c28c25e228636f3c4506dabd1386.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2901314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_9d7a94761d610cfc17ac19af1da89638.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3057449,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_b550c2c2ff4d14e6b511c1caaaef5cb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604137,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_5000744981a9dfe3b14ca4069cfcb662.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556094,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_6b7cefe8bcc48247072e83ddbb29e821.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91678a1-1303-5772-b759-08a4a52d4674/a91678a1-1303-5772-b759-08a4a52d4674_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3057991,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/44/c2443538e0609bbadc05fece26286ef6/pa/MZ48021_a76618cf54bdba9ecc41fe5b33fd8628.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-27 19:10:43 [auto1.nl] INFO: Saving data for MZ48021: {'created_time': 1774638643.840246, 'last_price_update_time': 1774638643.840255, 'auction_closing_time': 1774716557.0}
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ48021') HTTP/1.1" 204 0
2026-03-27 19:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332
2026-03-27 19:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332
2026-03-27 19:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332 to the API
2026-03-27 19:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_a2ca75f3a8f6eaf50e2c19b3533c6f40.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:12:48Z',
 'fuel_type': 'petrol',
 'id': '9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '33-GGT-9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG71332',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 152911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_b636547b3025e327c09595290f3840c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_7a37e8be2aed88f59cf17b7cf3a01066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_e599be46c21766bd85aa48eca5236643.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_5c5042f6727dfb36d1f08053633f44f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d/9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/e1/20e1e5baa71d67e211ee72ff67d2557f/pa/LG71332_a2ca75f3a8f6eaf50e2c19b3533c6f40.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [auto1.nl] INFO: Saving data for LG71332: {'created_time': 1774638644.173485, 'last_price_update_time': 1774638644.173496, 'auction_closing_time': 1774714368.0}
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG71332') HTTP/1.1" 204 0
2026-03-27 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ01481> (referer: https://www.auto1.com/v1/car-details-view/PZ01481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe96e366-c864-53ca-93a5-d20cdbc053c2 with identifier: PZ01481
2026-03-27 19:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe96e366-c864-53ca-93a5-d20cdbc053c2 with scrape type 1
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_8e7aab5e09eb074d6565de5afdf577ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_8e7aab5e09eb074d6565de5afdf577ca.jpg not downloaded yet
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_66dec978944b82a6f12af25d7f93bbcc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_66dec978944b82a6f12af25d7f93bbcc.jpg not downloaded yet
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_6092be8b5db784b10c08747abab4158b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_6092be8b5db784b10c08747abab4158b.jpg not downloaded yet
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_edf626852ecfe2545bac240f85304fd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_edf626852ecfe2545bac240f85304fd2.jpg not downloaded yet
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_af937f37ad7e83e0ce27d8351866633e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_af937f37ad7e83e0ce27d8351866633e.jpg not downloaded yet
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_d14f84c81dc9b7ca1c084179a6b233db.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_d14f84c81dc9b7ca1c084179a6b233db.jpg not downloaded yet
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_83f47b561c66b9746fcfafc5297236e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_83f47b561c66b9746fcfafc5297236e5.jpg not downloaded yet
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_759c34cd24b3ed790e78633595a0dbba.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_759c34cd24b3ed790e78633595a0dbba.jpg not downloaded yet
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_ccec73ba45e319a2bc509e4b2a47e8eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_ccec73ba45e319a2bc509e4b2a47e8eb.jpg not downloaded yet
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_a94786ff35c7103f45403b01edcdb66b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_a94786ff35c7103f45403b01edcdb66b.jpg not downloaded yet
2026-03-27 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_6092be8b5db784b10c08747abab4158b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_66dec978944b82a6f12af25d7f93bbcc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_af937f37ad7e83e0ce27d8351866633e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_8e7aab5e09eb074d6565de5afdf577ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_d14f84c81dc9b7ca1c084179a6b233db.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae329b2d0>
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_6092be8b5db784b10c08747abab4158b.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_6092be8b5db784b10c08747abab4158b.jpg saved to cache
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_83f47b561c66b9746fcfafc5297236e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_759c34cd24b3ed790e78633595a0dbba.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_a94786ff35c7103f45403b01edcdb66b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9669550>
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_66dec978944b82a6f12af25d7f93bbcc.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_66dec978944b82a6f12af25d7f93bbcc.jpg saved to cache
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32ecc50>
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_af937f37ad7e83e0ce27d8351866633e.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_af937f37ad7e83e0ce27d8351866633e.jpg saved to cache
2026-03-27 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33937d0>
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_8e7aab5e09eb074d6565de5afdf577ca.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_8e7aab5e09eb074d6565de5afdf577ca.jpg saved to cache
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae329cbd0>
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_d14f84c81dc9b7ca1c084179a6b233db.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_d14f84c81dc9b7ca1c084179a6b233db.jpg saved to cache
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34a81d0>
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_83f47b561c66b9746fcfafc5297236e5.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_83f47b561c66b9746fcfafc5297236e5.jpg saved to cache
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32059d0>
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_759c34cd24b3ed790e78633595a0dbba.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_759c34cd24b3ed790e78633595a0dbba.jpg saved to cache
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34de0d0>
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_a94786ff35c7103f45403b01edcdb66b.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_a94786ff35c7103f45403b01edcdb66b.jpg saved to cache
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_ccec73ba45e319a2bc509e4b2a47e8eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_edf626852ecfe2545bac240f85304fd2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX66014> (referer: https://www.auto1.com/v1/car-details-view/BX66014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3289050>
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_ccec73ba45e319a2bc509e4b2a47e8eb.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_ccec73ba45e319a2bc509e4b2a47e8eb.jpg saved to cache
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3591f10>
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F46%252Fc7461589266899732a2bad9e8d3a7fad%252Fpa%252FPZ01481_edf626852ecfe2545bac240f85304fd2.jpg') HTTP/1.1" 204 0
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_edf626852ecfe2545bac240f85304fd2.jpg saved to cache
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe96e366-c864-53ca-93a5-d20cdbc053c2
2026-03-27 19:10:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe96e366-c864-53ca-93a5-d20cdbc053c2, skipping ID generation
2026-03-27 19:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe96e366-c864-53ca-93a5-d20cdbc053c2 with scrape type 1
2026-03-27 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe96e366-c864-53ca-93a5-d20cdbc053c2 sending to next pipeline
2026-03-27 19:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fe96e366-c864-53ca-93a5-d20cdbc053c2, identifier: PZ01481
2026-03-27 19:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fe96e366-c864-53ca-93a5-d20cdbc053c2 with identifier: PZ01481
2026-03-27 19:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fe96e366-c864-53ca-93a5-d20cdbc053c2 with identifier: PZ01481
2026-03-27 19:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fe96e366-c864-53ca-93a5-d20cdbc053c2 with identifier: PZ01481 to the API
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_edf626852ecfe2545bac240f85304fd2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:10:09Z',
 'fuel_type': 'petrol',
 'id': 'fe96e366-c864-53ca-93a5-d20cdbc053c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TN970B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ01481',
 'listing': 'auction',
 'location': 'NL, Alkmaar',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 138367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2171677,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_8e7aab5e09eb074d6565de5afdf577ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_66dec978944b82a6f12af25d7f93bbcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2065575,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_6092be8b5db784b10c08747abab4158b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1992047,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_edf626852ecfe2545bac240f85304fd2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2039407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_af937f37ad7e83e0ce27d8351866633e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_d14f84c81dc9b7ca1c084179a6b233db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_83f47b561c66b9746fcfafc5297236e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_759c34cd24b3ed790e78633595a0dbba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2052797,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_ccec73ba45e319a2bc509e4b2a47e8eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe96e366-c864-53ca-93a5-d20cdbc053c2/fe96e366-c864-53ca-93a5-d20cdbc053c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/46/c7461589266899732a2bad9e8d3a7fad/pa/PZ01481_a94786ff35c7103f45403b01edcdb66b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ01481%27 HTTP/1.1" 200 None
2026-03-27 19:10:45 [auto1.nl] INFO: Saving data for PZ01481: {'created_time': 1774638645.991572, 'last_price_update_time': 1774638645.991582, 'auction_closing_time': 1774714209.0}
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PZ01481') HTTP/1.1" 204 0
2026-03-27 19:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014
2026-03-27 19:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c90c6f-46d6-5f66-901c-63a9880b940f with scrape type 1
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02c90c6f-46d6-5f66-901c-63a9880b940f
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_cfe967b18f5e77647f8cdde7bdf244f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_cfe967b18f5e77647f8cdde7bdf244f4.jpg already downloaded
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_80af208fff8390a7342b99c62a822749.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_80af208fff8390a7342b99c62a822749.jpg already downloaded
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_b6ba43e3292892b2bb5d074085254233.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_b6ba43e3292892b2bb5d074085254233.jpg already downloaded
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_550d1e9c62f46f4738d86c8e6c69567d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_550d1e9c62f46f4738d86c8e6c69567d.jpg already downloaded
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_0dcb1f5b44f78933bff751527ea1c416.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_0dcb1f5b44f78933bff751527ea1c416.jpg already downloaded
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_5a38d7c7ef400be7720231f8c7c3377e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_5a38d7c7ef400be7720231f8c7c3377e.jpg already downloaded
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_de39d0a8aa51a7a5ee6a6ec5d99aec79.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_de39d0a8aa51a7a5ee6a6ec5d99aec79.jpg already downloaded
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_b1ab3d1bb7e4c7df463073cc1c7aa40f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_b1ab3d1bb7e4c7df463073cc1c7aa40f.jpg already downloaded
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_c7f2be80f7b2972cacd7eeb7a8323279.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_c7f2be80f7b2972cacd7eeb7a8323279.jpg already downloaded
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd030b9584fd43da32c50681b452f730%252Fpa%252FBX66014_837a9fda42fad4b7ae220a423cea97d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_837a9fda42fad4b7ae220a423cea97d2.jpg already downloaded
2026-03-27 19:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02c90c6f-46d6-5f66-901c-63a9880b940f, identifier: BX66014
2026-03-27 19:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014
2026-03-27 19:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014
2026-03-27 19:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014 to the API
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX66014>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:01:56Z',
 'fuel_type': 'hybrid',
 'id': '02c90c6f-46d6-5f66-901c-63a9880b940f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '4-XPX-24',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX66014',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 217631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_cfe967b18f5e77647f8cdde7bdf244f4.jpg',
                'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_80af208fff8390a7342b99c62a822749.jpg',
                'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_b6ba43e3292892b2bb5d074085254233.jpg',
                'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_550d1e9c62f46f4738d86c8e6c69567d.jpg',
                'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_0dcb1f5b44f78933bff751527ea1c416.jpg',
                'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_5a38d7c7ef400be7720231f8c7c3377e.jpg',
                'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_de39d0a8aa51a7a5ee6a6ec5d99aec79.jpg',
                'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_b1ab3d1bb7e4c7df463073cc1c7aa40f.jpg',
                'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_c7f2be80f7b2972cacd7eeb7a8323279.jpg',
                'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_837a9fda42fad4b7ae220a423cea97d2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_cfe967b18f5e77647f8cdde7bdf244f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_80af208fff8390a7342b99c62a822749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_b6ba43e3292892b2bb5d074085254233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_550d1e9c62f46f4738d86c8e6c69567d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_0dcb1f5b44f78933bff751527ea1c416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_5a38d7c7ef400be7720231f8c7c3377e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_de39d0a8aa51a7a5ee6a6ec5d99aec79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_b1ab3d1bb7e4c7df463073cc1c7aa40f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_c7f2be80f7b2972cacd7eeb7a8323279.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c90c6f-46d6-5f66-901c-63a9880b940f/02c90c6f-46d6-5f66-901c-63a9880b940f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd030b9584fd43da32c50681b452f730/pa/BX66014_837a9fda42fad4b7ae220a423cea97d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h E-Four',
 'transmission': 'automatic',
 'trim': 'E-Four',
 'year': 2014}
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [auto1.nl] INFO: Saving data for BX66014: {'created_time': 1774638646.589572, 'last_price_update_time': 1774638646.589582, 'auction_closing_time': 1774713716.0}
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BX66014') HTTP/1.1" 204 0
2026-03-27 19:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:46 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:46 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ05855%27 HTTP/1.1" 200 None
2026-03-27 19:10:46 [auto1.nl] INFO: Scrape type for BZ05855: 2
2026-03-27 19:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7918e4a1-991a-5740-ad15-aca71c73bad2 with identifier: BZ05855
2026-03-27 19:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7918e4a1-991a-5740-ad15-aca71c73bad2 with scrape type 2
2026-03-27 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7918e4a1-991a-5740-ad15-aca71c73bad2 with scrape type 2
2026-03-27 19:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7918e4a1-991a-5740-ad15-aca71c73bad2, identifier: BZ05855
2026-03-27 19:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7918e4a1-991a-5740-ad15-aca71c73bad2 with identifier: BZ05855
2026-03-27 19:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7918e4a1-991a-5740-ad15-aca71c73bad2 with identifier: BZ05855
2026-03-27 19:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7918e4a1-991a-5740-ad15-aca71c73bad2 with identifier: BZ05855 to the API
2026-03-27 19:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:55:59Z',
 'fuel_type': 'petrol',
 'id': '7918e4a1-991a-5740-ad15-aca71c73bad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ05855',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 151807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Kia Rio 1.2 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2015}
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ05855%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Saving data for BZ05855: {'auction_closing_time': 1774716959.0, 'created_time': 1773231019.150597, 'last_price_update_time': 1774638647.135222}
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ05855') HTTP/1.1" 204 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP94169%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for GP94169: 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for LU83430: 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for JK88621: 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for AJ38016: 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN29511%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for LN29511: 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55235%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for EF55235: 2
2026-03-27 19:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb7a2efe-00cc-56f5-a903-ffb0be3e7fa2 with identifier: EF55235
2026-03-27 19:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb7a2efe-00cc-56f5-a903-ffb0be3e7fa2 with scrape type 2
2026-03-27 19:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb7a2efe-00cc-56f5-a903-ffb0be3e7fa2 with scrape type 2
2026-03-27 19:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fb7a2efe-00cc-56f5-a903-ffb0be3e7fa2, identifier: EF55235
2026-03-27 19:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fb7a2efe-00cc-56f5-a903-ffb0be3e7fa2 with identifier: EF55235
2026-03-27 19:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fb7a2efe-00cc-56f5-a903-ffb0be3e7fa2 with identifier: EF55235
2026-03-27 19:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fb7a2efe-00cc-56f5-a903-ffb0be3e7fa2 with identifier: EF55235 to the API
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:40:47Z',
 'fuel_type': 'petrol',
 'id': 'fb7a2efe-00cc-56f5-a903-ffb0be3e7fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF55235',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 149525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-06',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55235%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Saving data for EF55235: {'auction_closing_time': 1774716047.0, 'created_time': 1774440704.628625, 'last_price_update_time': 1774638647.624952}
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EF55235') HTTP/1.1" 204 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM94423%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for MM94423: 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF44438%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for JF44438: 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for JG46150: 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for VB13156: 0
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-27 19:10:47 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LM76108%27 HTTP/1.1" 200 None
2026-03-27 19:10:47 [auto1.nl] INFO: Scrape type for LM76108: 2
2026-03-27 19:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc8b1d8-f8e4-5f3b-95c2-1ad9c12539c9 with identifier: LM76108
2026-03-27 19:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc8b1d8-f8e4-5f3b-95c2-1ad9c12539c9 with scrape type 2
2026-03-27 19:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc8b1d8-f8e4-5f3b-95c2-1ad9c12539c9 with scrape type 2
2026-03-27 19:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4dc8b1d8-f8e4-5f3b-95c2-1ad9c12539c9, identifier: LM76108
2026-03-27 19:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4dc8b1d8-f8e4-5f3b-95c2-1ad9c12539c9 with identifier: LM76108
2026-03-27 19:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4dc8b1d8-f8e4-5f3b-95c2-1ad9c12539c9 with identifier: LM76108
2026-03-27 19:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4dc8b1d8-f8e4-5f3b-95c2-1ad9c12539c9 with identifier: LM76108 to the API
2026-03-27 19:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:38:26Z',
 'fuel_type': 'diesel',
 'id': '4dc8b1d8-f8e4-5f3b-95c2-1ad9c12539c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM76108',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 263886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-18',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2014}
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LM76108%27 HTTP/1.1" 200 None
2026-03-27 19:10:48 [auto1.nl] INFO: Saving data for LM76108: {'auction_closing_time': 1774715906.0, 'created_time': 1774440640.99646, 'last_price_update_time': 1774638648.153127}
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LM76108') HTTP/1.1" 204 0
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC25819%27 HTTP/1.1" 200 None
2026-03-27 19:10:48 [auto1.nl] INFO: Scrape type for PC25819: 0
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-27 19:10:48 [auto1.nl] INFO: Scrape type for FL02627: 0
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC83701%27 HTTP/1.1" 200 None
2026-03-27 19:10:48 [auto1.nl] INFO: Scrape type for UC83701: 0
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN34137%27 HTTP/1.1" 200 None
2026-03-27 19:10:48 [auto1.nl] INFO: Scrape type for PN34137: 0
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AU62322%27 HTTP/1.1" 200 None
2026-03-27 19:10:48 [auto1.nl] INFO: Scrape type for AU62322: 2
2026-03-27 19:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849220b3-e203-5995-8563-16160ae35176 with identifier: AU62322
2026-03-27 19:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849220b3-e203-5995-8563-16160ae35176 with scrape type 2
2026-03-27 19:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 849220b3-e203-5995-8563-16160ae35176 with scrape type 2
2026-03-27 19:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 849220b3-e203-5995-8563-16160ae35176, identifier: AU62322
2026-03-27 19:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 849220b3-e203-5995-8563-16160ae35176 with identifier: AU62322
2026-03-27 19:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 849220b3-e203-5995-8563-16160ae35176 with identifier: AU62322
2026-03-27 19:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 849220b3-e203-5995-8563-16160ae35176 with identifier: AU62322 to the API
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:38:34Z',
 'fuel_type': 'diesel',
 'id': '849220b3-e203-5995-8563-16160ae35176',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU62322',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 348372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AU62322%27 HTTP/1.1" 200 None
2026-03-27 19:10:48 [auto1.nl] INFO: Saving data for AU62322: {'auction_closing_time': 1774715914.0, 'created_time': 1774440650.45591, 'last_price_update_time': 1774638648.668795}
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AU62322') HTTP/1.1" 204 0
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-27 19:10:48 [auto1.nl] INFO: Scrape type for VD56637: 0
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-27 19:10:48 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-27 19:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:49 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:49 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-27 19:10:49 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-27 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS68012%27 HTTP/1.1" 200 None
2026-03-27 19:10:49 [auto1.nl] INFO: Scrape type for YS68012: 2
2026-03-27 19:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 210c754a-370b-51a4-8d3a-2f101e8f0bd5 with identifier: YS68012
2026-03-27 19:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 210c754a-370b-51a4-8d3a-2f101e8f0bd5 with scrape type 2
2026-03-27 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 210c754a-370b-51a4-8d3a-2f101e8f0bd5 with scrape type 2
2026-03-27 19:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 210c754a-370b-51a4-8d3a-2f101e8f0bd5, identifier: YS68012
2026-03-27 19:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 210c754a-370b-51a4-8d3a-2f101e8f0bd5 with identifier: YS68012
2026-03-27 19:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 210c754a-370b-51a4-8d3a-2f101e8f0bd5 with identifier: YS68012
2026-03-27 19:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 210c754a-370b-51a4-8d3a-2f101e8f0bd5 with identifier: YS68012 to the API
2026-03-27 19:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-28T16:55:19Z',
 'fuel_type': 'diesel',
 'id': '210c754a-370b-51a4-8d3a-2f101e8f0bd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS68012',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XJ',
 'odometer': 302894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-07',
 'seller_name': None,
 'title': 'Jaguar XJ 2.7 D V6 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2006}
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS68012%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Saving data for YS68012: {'auction_closing_time': 1774716919.0, 'created_time': 1774440694.999072, 'last_price_update_time': 1774638650.051724}
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YS68012') HTTP/1.1" 204 0
2026-03-27 19:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22274%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Scrape type for SV22274: 0
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS79214%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Scrape type for AS79214: 0
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD33602%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Scrape type for FD33602: 0
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP56929%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Scrape type for UP56929: 2
2026-03-27 19:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf8b70c3-58d2-5bd4-92aa-f13af069b065 with identifier: UP56929
2026-03-27 19:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf8b70c3-58d2-5bd4-92aa-f13af069b065 with scrape type 2
2026-03-27 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf8b70c3-58d2-5bd4-92aa-f13af069b065 with scrape type 2
2026-03-27 19:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cf8b70c3-58d2-5bd4-92aa-f13af069b065, identifier: UP56929
2026-03-27 19:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cf8b70c3-58d2-5bd4-92aa-f13af069b065 with identifier: UP56929
2026-03-27 19:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cf8b70c3-58d2-5bd4-92aa-f13af069b065 with identifier: UP56929
2026-03-27 19:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cf8b70c3-58d2-5bd4-92aa-f13af069b065 with identifier: UP56929 to the API
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:36:43Z',
 'fuel_type': 'diesel',
 'id': 'cf8b70c3-58d2-5bd4-92aa-f13af069b065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP56929',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 149375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Linje Svart',
 'transmission': 'automatic',
 'trim': 'Linje Svart',
 'year': 2015}
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP56929%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Saving data for UP56929: {'auction_closing_time': 1774715803.0, 'created_time': 1774440633.165784, 'last_price_update_time': 1774638650.557794}
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UP56929') HTTP/1.1" 204 0
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TK93788%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Scrape type for TK93788: 0
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Scrape type for BZ75535: 0
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-27 19:10:50 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Scrape type for XD61678: 2
2026-03-27 19:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5745546f-60dd-5830-9c19-34acea5756c7 with identifier: XD61678
2026-03-27 19:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5745546f-60dd-5830-9c19-34acea5756c7 with scrape type 2
2026-03-27 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5745546f-60dd-5830-9c19-34acea5756c7 with scrape type 2
2026-03-27 19:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5745546f-60dd-5830-9c19-34acea5756c7, identifier: XD61678
2026-03-27 19:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5745546f-60dd-5830-9c19-34acea5756c7 with identifier: XD61678
2026-03-27 19:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5745546f-60dd-5830-9c19-34acea5756c7 with identifier: XD61678
2026-03-27 19:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5745546f-60dd-5830-9c19-34acea5756c7 with identifier: XD61678 to the API
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:32:26Z',
 'fuel_type': 'petrol',
 'id': '5745546f-60dd-5830-9c19-34acea5756c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD61678',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 251536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2014}
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-27 19:10:50 [auto1.nl] INFO: Saving data for XD61678: {'auction_closing_time': 1774715546.0, 'created_time': 1774552236.144758, 'last_price_update_time': 1774638650.957221}
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XD61678') HTTP/1.1" 204 0
2026-03-27 19:10:51 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX58095%27 HTTP/1.1" 200 None
2026-03-27 19:10:51 [auto1.nl] INFO: Scrape type for NX58095: 0
2026-03-27 19:10:51 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-27 19:10:51 [auto1.nl] INFO: Scrape type for XA55617: 2
2026-03-27 19:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with identifier: XA55617
2026-03-27 19:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with scrape type 2
2026-03-27 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with scrape type 2
2026-03-27 19:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ef1c8856-9155-5260-8e16-8d1b0f1e39e6, identifier: XA55617
2026-03-27 19:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with identifier: XA55617
2026-03-27 19:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with identifier: XA55617
2026-03-27 19:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with identifier: XA55617 to the API
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:10:42Z',
 'fuel_type': 'petrol',
 'id': 'ef1c8856-9155-5260-8e16-8d1b0f1e39e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA55617',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 111176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-27 19:10:51 [auto1.nl] INFO: Saving data for XA55617: {'auction_closing_time': 1774714242.0, 'created_time': 1773134718.982045, 'last_price_update_time': 1774638651.442063}
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XA55617') HTTP/1.1" 204 0
2026-03-27 19:10:51 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH47891%27 HTTP/1.1" 200 None
2026-03-27 19:10:51 [auto1.nl] INFO: Scrape type for BH47891: 2
2026-03-27 19:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea1e6de-d23b-5d8b-bb87-2384c184ab3c with identifier: BH47891
2026-03-27 19:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea1e6de-d23b-5d8b-bb87-2384c184ab3c with scrape type 2
2026-03-27 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ea1e6de-d23b-5d8b-bb87-2384c184ab3c with scrape type 2
2026-03-27 19:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ea1e6de-d23b-5d8b-bb87-2384c184ab3c, identifier: BH47891
2026-03-27 19:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ea1e6de-d23b-5d8b-bb87-2384c184ab3c with identifier: BH47891
2026-03-27 19:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ea1e6de-d23b-5d8b-bb87-2384c184ab3c with identifier: BH47891
2026-03-27 19:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ea1e6de-d23b-5d8b-bb87-2384c184ab3c with identifier: BH47891 to the API
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:18:22Z',
 'fuel_type': 'petrol',
 'id': '9ea1e6de-d23b-5d8b-bb87-2384c184ab3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH47891',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 277997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-04',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 Scout',
 'transmission': 'manual',
 'trim': 'Scout',
 'year': 2009}
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH47891%27 HTTP/1.1" 200 None
2026-03-27 19:10:51 [auto1.nl] INFO: Saving data for BH47891: {'auction_closing_time': 1774714702.0, 'created_time': 1773861350.017796, 'last_price_update_time': 1774638651.834439}
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BH47891') HTTP/1.1" 204 0
2026-03-27 19:10:51 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-27 19:10:51 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-27 19:10:51 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST98483%27 HTTP/1.1" 200 None
2026-03-27 19:10:51 [auto1.nl] INFO: Scrape type for ST98483: 0
2026-03-27 19:10:51 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-27 19:10:51 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZV50646%27 HTTP/1.1" 200 None
2026-03-27 19:10:51 [auto1.nl] INFO: Scrape type for ZV50646: 2
2026-03-27 19:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0643acba-16ee-5e61-b568-2fcf2f7fcd03 with identifier: ZV50646
2026-03-27 19:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0643acba-16ee-5e61-b568-2fcf2f7fcd03 with scrape type 2
2026-03-27 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0643acba-16ee-5e61-b568-2fcf2f7fcd03 with scrape type 2
2026-03-27 19:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0643acba-16ee-5e61-b568-2fcf2f7fcd03, identifier: ZV50646
2026-03-27 19:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0643acba-16ee-5e61-b568-2fcf2f7fcd03 with identifier: ZV50646
2026-03-27 19:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0643acba-16ee-5e61-b568-2fcf2f7fcd03 with identifier: ZV50646
2026-03-27 19:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0643acba-16ee-5e61-b568-2fcf2f7fcd03 with identifier: ZV50646 to the API
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:05:16Z',
 'fuel_type': 'petrol',
 'id': '0643acba-16ee-5e61-b568-2fcf2f7fcd03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV50646',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 282638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-14',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active Blockbuster',
 'transmission': 'manual',
 'trim': 'Active Blockbuster',
 'year': 2013}
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZV50646%27 HTTP/1.1" 200 None
2026-03-27 19:10:52 [auto1.nl] INFO: Saving data for ZV50646: {'auction_closing_time': 1774713916.0, 'created_time': 1774465825.073194, 'last_price_update_time': 1774638652.224988}
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZV50646') HTTP/1.1" 204 0
2026-03-27 19:10:52 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-27 19:10:52 [auto1.nl] INFO: Scrape type for FL22944: 2
2026-03-27 19:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0191c7b-337f-58ba-829a-01ab6fb3759f with identifier: FL22944
2026-03-27 19:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0191c7b-337f-58ba-829a-01ab6fb3759f with scrape type 2
2026-03-27 19:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0191c7b-337f-58ba-829a-01ab6fb3759f with scrape type 2
2026-03-27 19:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c0191c7b-337f-58ba-829a-01ab6fb3759f, identifier: FL22944
2026-03-27 19:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c0191c7b-337f-58ba-829a-01ab6fb3759f with identifier: FL22944
2026-03-27 19:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c0191c7b-337f-58ba-829a-01ab6fb3759f with identifier: FL22944
2026-03-27 19:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c0191c7b-337f-58ba-829a-01ab6fb3759f with identifier: FL22944 to the API
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:36:33Z',
 'fuel_type': 'diesel',
 'id': 'c0191c7b-337f-58ba-829a-01ab6fb3759f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL22944',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 298627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2010}
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-27 19:10:52 [auto1.nl] INFO: Saving data for FL22944: {'auction_closing_time': 1774715793.0, 'created_time': 1774552237.912237, 'last_price_update_time': 1774638652.636816}
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FL22944') HTTP/1.1" 204 0
2026-03-27 19:10:52 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-27 19:10:52 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-27 19:10:52 [auto1.nl] INFO: Scrape type for BM96536: 0
2026-03-27 19:10:52 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-27 19:10:52 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP53707%27 HTTP/1.1" 200 None
2026-03-27 19:10:52 [auto1.nl] INFO: Scrape type for ZP53707: 0
2026-03-27 19:10:52 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-27 19:10:52 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-27 19:10:52 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-27 19:10:52 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS66279%27 HTTP/1.1" 200 None
2026-03-27 19:10:52 [auto1.nl] INFO: Scrape type for DS66279: 2
2026-03-27 19:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9770bf7b-d300-5582-b8a7-a7be05511bbb with identifier: DS66279
2026-03-27 19:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9770bf7b-d300-5582-b8a7-a7be05511bbb with scrape type 2
2026-03-27 19:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9770bf7b-d300-5582-b8a7-a7be05511bbb with scrape type 2
2026-03-27 19:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9770bf7b-d300-5582-b8a7-a7be05511bbb, identifier: DS66279
2026-03-27 19:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9770bf7b-d300-5582-b8a7-a7be05511bbb with identifier: DS66279
2026-03-27 19:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9770bf7b-d300-5582-b8a7-a7be05511bbb with identifier: DS66279
2026-03-27 19:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9770bf7b-d300-5582-b8a7-a7be05511bbb with identifier: DS66279 to the API
2026-03-27 19:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 113,
 'expiration_date': '2026-03-28T16:54:17Z',
 'fuel_type': 'petrol',
 'id': '9770bf7b-d300-5582-b8a7-a7be05511bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS66279',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 179496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-11',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Dynamique Luxe',
 'transmission': 'manual',
 'trim': 'Dynamique Luxe',
 'year': 2005}
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS66279%27 HTTP/1.1" 200 None
2026-03-27 19:10:53 [auto1.nl] INFO: Saving data for DS66279: {'auction_closing_time': 1774716857.0, 'created_time': 1774440643.682741, 'last_price_update_time': 1774638653.12351}
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DS66279') HTTP/1.1" 204 0
2026-03-27 19:10:53 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RS83136%27 HTTP/1.1" 200 None
2026-03-27 19:10:53 [auto1.nl] INFO: Scrape type for RS83136: 2
2026-03-27 19:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 851c65e3-eb00-502a-b849-52d39b6ecce1 with identifier: RS83136
2026-03-27 19:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 851c65e3-eb00-502a-b849-52d39b6ecce1 with scrape type 2
2026-03-27 19:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 851c65e3-eb00-502a-b849-52d39b6ecce1 with scrape type 2
2026-03-27 19:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 851c65e3-eb00-502a-b849-52d39b6ecce1, identifier: RS83136
2026-03-27 19:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 851c65e3-eb00-502a-b849-52d39b6ecce1 with identifier: RS83136
2026-03-27 19:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 851c65e3-eb00-502a-b849-52d39b6ecce1 with identifier: RS83136
2026-03-27 19:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 851c65e3-eb00-502a-b849-52d39b6ecce1 with identifier: RS83136 to the API
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:16:25Z',
 'fuel_type': 'petrol',
 'id': '851c65e3-eb00-502a-b849-52d39b6ecce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS83136',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 146152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-17',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RS83136%27 HTTP/1.1" 200 None
2026-03-27 19:10:53 [auto1.nl] INFO: Saving data for RS83136: {'auction_closing_time': 1774714585.0, 'created_time': 1774440713.918711, 'last_price_update_time': 1774638653.578781}
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RS83136') HTTP/1.1" 204 0
2026-03-27 19:10:53 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-27 19:10:53 [auto1.nl] INFO: Scrape type for BD37870: 0
2026-03-27 19:10:53 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK22988%27 HTTP/1.1" 200 None
2026-03-27 19:10:53 [auto1.nl] INFO: Scrape type for PK22988: 0
2026-03-27 19:10:53 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL29308%27 HTTP/1.1" 200 None
2026-03-27 19:10:53 [auto1.nl] INFO: Scrape type for HL29308: 2
2026-03-27 19:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24e81464-b033-57f2-9c60-482733dba018 with identifier: HL29308
2026-03-27 19:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24e81464-b033-57f2-9c60-482733dba018 with scrape type 2
2026-03-27 19:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24e81464-b033-57f2-9c60-482733dba018 with scrape type 2
2026-03-27 19:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 24e81464-b033-57f2-9c60-482733dba018, identifier: HL29308
2026-03-27 19:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 24e81464-b033-57f2-9c60-482733dba018 with identifier: HL29308
2026-03-27 19:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 24e81464-b033-57f2-9c60-482733dba018 with identifier: HL29308
2026-03-27 19:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 24e81464-b033-57f2-9c60-482733dba018 with identifier: HL29308 to the API
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:46:44Z',
 'fuel_type': 'diesel',
 'id': '24e81464-b033-57f2-9c60-482733dba018',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL29308',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 228705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-19',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2014}
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL29308%27 HTTP/1.1" 200 None
2026-03-27 19:10:53 [auto1.nl] INFO: Saving data for HL29308: {'auction_closing_time': 1774716404.0, 'created_time': 1774440632.238695, 'last_price_update_time': 1774638653.976805}
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HL29308') HTTP/1.1" 204 0
2026-03-27 19:10:53 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-27 19:10:54 [auto1.nl] INFO: Scrape type for DG66253: 0
2026-03-27 19:10:54 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WL71666%27 HTTP/1.1" 200 None
2026-03-27 19:10:54 [auto1.nl] INFO: Scrape type for WL71666: 0
2026-03-27 19:10:54 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-27 19:10:54 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG13282%27 HTTP/1.1" 200 None
2026-03-27 19:10:54 [auto1.nl] INFO: Scrape type for BG13282: 0
2026-03-27 19:10:54 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT24375%27 HTTP/1.1" 200 None
2026-03-27 19:10:54 [auto1.nl] INFO: Scrape type for AT24375: 2
2026-03-27 19:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38fa1b19-b47a-5955-ba1e-cdc2f5274442 with identifier: AT24375
2026-03-27 19:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38fa1b19-b47a-5955-ba1e-cdc2f5274442 with scrape type 2
2026-03-27 19:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38fa1b19-b47a-5955-ba1e-cdc2f5274442 with scrape type 2
2026-03-27 19:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 38fa1b19-b47a-5955-ba1e-cdc2f5274442, identifier: AT24375
2026-03-27 19:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 38fa1b19-b47a-5955-ba1e-cdc2f5274442 with identifier: AT24375
2026-03-27 19:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 38fa1b19-b47a-5955-ba1e-cdc2f5274442 with identifier: AT24375
2026-03-27 19:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 38fa1b19-b47a-5955-ba1e-cdc2f5274442 with identifier: AT24375 to the API
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:17:35Z',
 'fuel_type': 'hybrid',
 'id': '38fa1b19-b47a-5955-ba1e-cdc2f5274442',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT24375',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 77355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-29',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT24375%27 HTTP/1.1" 200 None
2026-03-27 19:10:54 [auto1.nl] INFO: Saving data for AT24375: {'auction_closing_time': 1774714655.0, 'created_time': 1774440717.007823, 'last_price_update_time': 1774638654.410048}
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AT24375') HTTP/1.1" 204 0
2026-03-27 19:10:54 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:54 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK53801%27 HTTP/1.1" 200 None
2026-03-27 19:10:54 [auto1.nl] INFO: Scrape type for MK53801: 2
2026-03-27 19:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76590eaf-9aec-51c0-ad66-1e466b8b1f0c with identifier: MK53801
2026-03-27 19:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76590eaf-9aec-51c0-ad66-1e466b8b1f0c with scrape type 2
2026-03-27 19:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76590eaf-9aec-51c0-ad66-1e466b8b1f0c with scrape type 2
2026-03-27 19:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 76590eaf-9aec-51c0-ad66-1e466b8b1f0c, identifier: MK53801
2026-03-27 19:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 76590eaf-9aec-51c0-ad66-1e466b8b1f0c with identifier: MK53801
2026-03-27 19:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 76590eaf-9aec-51c0-ad66-1e466b8b1f0c with identifier: MK53801
2026-03-27 19:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 76590eaf-9aec-51c0-ad66-1e466b8b1f0c with identifier: MK53801 to the API
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:31:59Z',
 'fuel_type': 'petrol',
 'id': '76590eaf-9aec-51c0-ad66-1e466b8b1f0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK53801',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 103800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-29',
 'seller_name': None,
 'title': 'Citroen C4 1.2 e-THP Business Class',
 'transmission': 'manual',
 'trim': 'Business Class',
 'year': 2015}
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK53801%27 HTTP/1.1" 200 None
2026-03-27 19:10:54 [auto1.nl] INFO: Saving data for MK53801: {'auction_closing_time': 1774715519.0, 'created_time': 1773343810.518487, 'last_price_update_time': 1774638654.793461}
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MK53801') HTTP/1.1" 204 0
2026-03-27 19:10:54 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-27 19:10:54 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-27 19:10:54 [auto1.nl] INFO: Scrape type for SV01425: 0
2026-03-27 19:10:54 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-27 19:10:54 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN10776%27 HTTP/1.1" 200 None
2026-03-27 19:10:54 [auto1.nl] INFO: Scrape type for NN10776: 2
2026-03-27 19:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad64ba1c-a442-520d-b4ff-5ff29fc9ac20 with identifier: NN10776
2026-03-27 19:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad64ba1c-a442-520d-b4ff-5ff29fc9ac20 with scrape type 2
2026-03-27 19:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad64ba1c-a442-520d-b4ff-5ff29fc9ac20 with scrape type 2
2026-03-27 19:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad64ba1c-a442-520d-b4ff-5ff29fc9ac20, identifier: NN10776
2026-03-27 19:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad64ba1c-a442-520d-b4ff-5ff29fc9ac20 with identifier: NN10776
2026-03-27 19:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad64ba1c-a442-520d-b4ff-5ff29fc9ac20 with identifier: NN10776
2026-03-27 19:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad64ba1c-a442-520d-b4ff-5ff29fc9ac20 with identifier: NN10776 to the API
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:44:18Z',
 'fuel_type': 'petrol',
 'id': 'ad64ba1c-a442-520d-b4ff-5ff29fc9ac20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN10776',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 179103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-24',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2014}
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN10776%27 HTTP/1.1" 200 None
2026-03-27 19:10:55 [auto1.nl] INFO: Saving data for NN10776: {'auction_closing_time': 1774716258.0, 'created_time': 1774440679.36658, 'last_price_update_time': 1774638655.187718}
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NN10776') HTTP/1.1" 204 0
2026-03-27 19:10:55 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-27 19:10:55 [auto1.nl] INFO: Scrape type for AZ90827: 2
2026-03-27 19:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09bb1312-3a4a-5a45-a830-efd44ed88bba with identifier: AZ90827
2026-03-27 19:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09bb1312-3a4a-5a45-a830-efd44ed88bba with scrape type 2
2026-03-27 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09bb1312-3a4a-5a45-a830-efd44ed88bba with scrape type 2
2026-03-27 19:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 09bb1312-3a4a-5a45-a830-efd44ed88bba, identifier: AZ90827
2026-03-27 19:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 09bb1312-3a4a-5a45-a830-efd44ed88bba with identifier: AZ90827
2026-03-27 19:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 09bb1312-3a4a-5a45-a830-efd44ed88bba with identifier: AZ90827
2026-03-27 19:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 09bb1312-3a4a-5a45-a830-efd44ed88bba with identifier: AZ90827 to the API
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:17:24Z',
 'fuel_type': 'petrol',
 'id': '09bb1312-3a4a-5a45-a830-efd44ed88bba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ90827',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 73604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-21',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2004}
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-27 19:10:55 [auto1.nl] INFO: Saving data for AZ90827: {'auction_closing_time': 1774714644.0, 'created_time': 1774552224.221834, 'last_price_update_time': 1774638655.6269}
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AZ90827') HTTP/1.1" 204 0
2026-03-27 19:10:55 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD16289%27 HTTP/1.1" 200 None
2026-03-27 19:10:55 [auto1.nl] INFO: Scrape type for PD16289: 2
2026-03-27 19:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with identifier: PD16289
2026-03-27 19:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with scrape type 2
2026-03-27 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with scrape type 2
2026-03-27 19:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5dbca311-f3b9-593c-8b35-49acac5cd0b5, identifier: PD16289
2026-03-27 19:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with identifier: PD16289
2026-03-27 19:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with identifier: PD16289
2026-03-27 19:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with identifier: PD16289 to the API
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:34Z',
 'fuel_type': 'petrol',
 'id': '5dbca311-f3b9-593c-8b35-49acac5cd0b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD16289',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 219899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-05',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 Avantage 2009',
 'transmission': 'manual',
 'trim': 'Avantage 2009',
 'year': 2009}
2026-03-27 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD16289%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Saving data for PD16289: {'auction_closing_time': 1774713874.0, 'created_time': 1774440631.388149, 'last_price_update_time': 1774638656.005828}
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PD16289') HTTP/1.1" 204 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK38952%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for AK38952: 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR94083%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for JR94083: 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN78419%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for GN78419: 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: BF56002
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF56002%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for BF56002: 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN62257%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for JN62257: 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for YK98733: 2
2026-03-27 19:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with identifier: YK98733
2026-03-27 19:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with scrape type 2
2026-03-27 19:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with scrape type 2
2026-03-27 19:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b54801e-7750-5838-a4bc-1b09cb88f8c8, identifier: YK98733
2026-03-27 19:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with identifier: YK98733
2026-03-27 19:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with identifier: YK98733
2026-03-27 19:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with identifier: YK98733 to the API
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:32:26Z',
 'fuel_type': 'petrol',
 'id': '6b54801e-7750-5838-a4bc-1b09cb88f8c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK98733',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 153997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-24',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Saving data for YK98733: {'auction_closing_time': 1774715546.0, 'created_time': 1774552235.174993, 'last_price_update_time': 1774638656.553818}
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YK98733') HTTP/1.1" 204 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for RX80263: 1
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH52378%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for GH52378: 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ87592%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for YZ87592: 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for WJ55319: 0
2026-03-27 19:10:56 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG63476%27 HTTP/1.1" 200 None
2026-03-27 19:10:56 [auto1.nl] INFO: Scrape type for TG63476: 2
2026-03-27 19:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d35deb9d-47db-5c83-9f1a-7e749873875a with identifier: TG63476
2026-03-27 19:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d35deb9d-47db-5c83-9f1a-7e749873875a with scrape type 2
2026-03-27 19:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d35deb9d-47db-5c83-9f1a-7e749873875a with scrape type 2
2026-03-27 19:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d35deb9d-47db-5c83-9f1a-7e749873875a, identifier: TG63476
2026-03-27 19:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d35deb9d-47db-5c83-9f1a-7e749873875a with identifier: TG63476
2026-03-27 19:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d35deb9d-47db-5c83-9f1a-7e749873875a with identifier: TG63476
2026-03-27 19:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d35deb9d-47db-5c83-9f1a-7e749873875a with identifier: TG63476 to the API
2026-03-27 19:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:51:31Z',
 'fuel_type': 'petrol',
 'id': 'd35deb9d-47db-5c83-9f1a-7e749873875a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG63476',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 106267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG63476%27 HTTP/1.1" 200 None
2026-03-27 19:10:57 [auto1.nl] INFO: Saving data for TG63476: {'auction_closing_time': 1774716691.0, 'created_time': 1774440710.865989, 'last_price_update_time': 1774638657.153387}
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TG63476') HTTP/1.1" 204 0
2026-03-27 19:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-27 19:10:57 [auto1.nl] INFO: Scrape type for HW48392: 0
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA29712%27 HTTP/1.1" 200 None
2026-03-27 19:10:57 [auto1.nl] INFO: Scrape type for NA29712: 2
2026-03-27 19:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e38dce-3875-5108-8dc3-312b5ee3a494 with identifier: NA29712
2026-03-27 19:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e38dce-3875-5108-8dc3-312b5ee3a494 with scrape type 2
2026-03-27 19:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e38dce-3875-5108-8dc3-312b5ee3a494 with scrape type 2
2026-03-27 19:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7e38dce-3875-5108-8dc3-312b5ee3a494, identifier: NA29712
2026-03-27 19:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7e38dce-3875-5108-8dc3-312b5ee3a494 with identifier: NA29712
2026-03-27 19:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7e38dce-3875-5108-8dc3-312b5ee3a494 with identifier: NA29712
2026-03-27 19:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7e38dce-3875-5108-8dc3-312b5ee3a494 with identifier: NA29712 to the API
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:07:03Z',
 'fuel_type': 'diesel',
 'id': 'e7e38dce-3875-5108-8dc3-312b5ee3a494',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA29712',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 276160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-30',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 HDi L2H1 29 Kasten',
 'transmission': 'manual',
 'trim': 'L2H1 29 Kasten',
 'year': 2016}
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA29712%27 HTTP/1.1" 200 None
2026-03-27 19:10:57 [auto1.nl] INFO: Saving data for NA29712: {'auction_closing_time': 1774714023.0, 'created_time': 1773861289.726633, 'last_price_update_time': 1774638657.617641}
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NA29712') HTTP/1.1" 204 0
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL27027%27 HTTP/1.1" 200 None
2026-03-27 19:10:57 [auto1.nl] INFO: Scrape type for RL27027: 0
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-27 19:10:57 [auto1.nl] INFO: Scrape type for GY41852: 0
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-27 19:10:57 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-27 19:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:58 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 916 | hits on page: 40
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL15145%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for HL15145: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH65457%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for JH65457: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG59138%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for NG59138: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX87837%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for RX87837: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG73581%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for DG73581: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for JS13271: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for NB25760: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: GM40908
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE69449%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for TE69449: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for ME98271: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR08683%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for YR08683: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for BD28084: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR97495%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for LR97495: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: SP67754
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SP67754%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for SP67754: 1
2026-03-27 19:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT81070%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for VT81070: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS78971%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for AS78971: 0
2026-03-27 19:10:58 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN86188%27 HTTP/1.1" 200 None
2026-03-27 19:10:58 [auto1.nl] INFO: Scrape type for TN86188: 2
2026-03-27 19:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18b925a2-a3a9-5157-a071-66de6d22ed92 with identifier: TN86188
2026-03-27 19:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b925a2-a3a9-5157-a071-66de6d22ed92 with scrape type 2
2026-03-27 19:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18b925a2-a3a9-5157-a071-66de6d22ed92 with scrape type 2
2026-03-27 19:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 18b925a2-a3a9-5157-a071-66de6d22ed92, identifier: TN86188
2026-03-27 19:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 18b925a2-a3a9-5157-a071-66de6d22ed92 with identifier: TN86188
2026-03-27 19:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 18b925a2-a3a9-5157-a071-66de6d22ed92 with identifier: TN86188
2026-03-27 19:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 18b925a2-a3a9-5157-a071-66de6d22ed92 with identifier: TN86188 to the API
2026-03-27 19:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:19Z',
 'fuel_type': 'petrol',
 'id': '18b925a2-a3a9-5157-a071-66de6d22ed92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN86188',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 118273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-18',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2016}
2026-03-27 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN86188%27 HTTP/1.1" 200 None
2026-03-27 19:10:59 [auto1.nl] INFO: Saving data for TN86188: {'auction_closing_time': 1774715359.0, 'created_time': 1773134956.450212, 'last_price_update_time': 1774638659.127265}
2026-03-27 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN86188') HTTP/1.1" 204 0
2026-03-27 19:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:59 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-27 19:10:59 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-27 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN23343%27 HTTP/1.1" 200 None
2026-03-27 19:10:59 [auto1.nl] INFO: Scrape type for DN23343: 0
2026-03-27 19:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX80263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP67754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX80263> (referer: https://www.auto1.com/v1/car-details-view/RX80263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7576818-67f8-5e0e-a054-e78ef028fd16 with identifier: RX80263
2026-03-27 19:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7576818-67f8-5e0e-a054-e78ef028fd16 with scrape type 1
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a7576818-67f8-5e0e-a054-e78ef028fd16
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_26318752551c07065cd4edf2da8d59b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_26318752551c07065cd4edf2da8d59b5.jpg not downloaded yet
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_9f8dcc3d6e0f749ab67f5705230e490e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_9f8dcc3d6e0f749ab67f5705230e490e.jpg not downloaded yet
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_ca5cba251f29df762497df4efc2a493a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_ca5cba251f29df762497df4efc2a493a.jpg not downloaded yet
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_85b7a3a3871b36f4b93b8539cdf6e7f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_85b7a3a3871b36f4b93b8539cdf6e7f7.jpg not downloaded yet
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_582b6356a693d493b1633bf601b9a449.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_582b6356a693d493b1633bf601b9a449.jpg not downloaded yet
2026-03-27 19:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_26318752551c07065cd4edf2da8d59b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_9f8dcc3d6e0f749ab67f5705230e490e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_582b6356a693d493b1633bf601b9a449.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_ca5cba251f29df762497df4efc2a493a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_85b7a3a3871b36f4b93b8539cdf6e7f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae328f650>
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_26318752551c07065cd4edf2da8d59b5.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_26318752551c07065cd4edf2da8d59b5.jpg saved to cache
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7576818-67f8-5e0e-a054-e78ef028fd16
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3430450>
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_9f8dcc3d6e0f749ab67f5705230e490e.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_9f8dcc3d6e0f749ab67f5705230e490e.jpg saved to cache
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7576818-67f8-5e0e-a054-e78ef028fd16
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2923410>
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_582b6356a693d493b1633bf601b9a449.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_582b6356a693d493b1633bf601b9a449.jpg saved to cache
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7576818-67f8-5e0e-a054-e78ef028fd16
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35900d0>
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_ca5cba251f29df762497df4efc2a493a.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_ca5cba251f29df762497df4efc2a493a.jpg saved to cache
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7576818-67f8-5e0e-a054-e78ef028fd16
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34ded10>
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F16%252F201615f959c3a99583922043894f2bbd%252Fpa%252FRX80263_85b7a3a3871b36f4b93b8539cdf6e7f7.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_85b7a3a3871b36f4b93b8539cdf6e7f7.jpg saved to cache
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7576818-67f8-5e0e-a054-e78ef028fd16
2026-03-27 19:11:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7576818-67f8-5e0e-a054-e78ef028fd16, skipping ID generation
2026-03-27 19:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7576818-67f8-5e0e-a054-e78ef028fd16 with scrape type 1
2026-03-27 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7576818-67f8-5e0e-a054-e78ef028fd16 sending to next pipeline
2026-03-27 19:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7576818-67f8-5e0e-a054-e78ef028fd16, identifier: RX80263
2026-03-27 19:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7576818-67f8-5e0e-a054-e78ef028fd16 with identifier: RX80263
2026-03-27 19:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7576818-67f8-5e0e-a054-e78ef028fd16 with identifier: RX80263
2026-03-27 19:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7576818-67f8-5e0e-a054-e78ef028fd16 with identifier: RX80263 to the API
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_85b7a3a3871b36f4b93b8539cdf6e7f7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:47:08Z',
 'fuel_type': 'petrol',
 'id': 'a7576818-67f8-5e0e-a054-e78ef028fd16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '60NGS6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX80263',
 'listing': 'auction',
 'location': 'NL, Dordrecht',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 328040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_26318752551c07065cd4edf2da8d59b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_9f8dcc3d6e0f749ab67f5705230e490e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_ca5cba251f29df762497df4efc2a493a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_85b7a3a3871b36f4b93b8539cdf6e7f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7576818-67f8-5e0e-a054-e78ef028fd16/a7576818-67f8-5e0e-a054-e78ef028fd16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/16/201615f959c3a99583922043894f2bbd/pa/RX80263_582b6356a693d493b1633bf601b9a449.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-27 19:11:01 [auto1.nl] INFO: Saving data for RX80263: {'created_time': 1774638661.296761, 'last_price_update_time': 1774638661.296772, 'auction_closing_time': 1774716428.0}
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RX80263') HTTP/1.1" 204 0
2026-03-27 19:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:01 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 916 | hits on page: 40
2026-03-27 19:11:01 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ31508%27 HTTP/1.1" 200 None
2026-03-27 19:11:01 [auto1.nl] INFO: Scrape type for PZ31508: 2
2026-03-27 19:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96dabe3-80e4-569f-b0eb-e9607a13251f with identifier: PZ31508
2026-03-27 19:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96dabe3-80e4-569f-b0eb-e9607a13251f with scrape type 2
2026-03-27 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e96dabe3-80e4-569f-b0eb-e9607a13251f with scrape type 2
2026-03-27 19:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e96dabe3-80e4-569f-b0eb-e9607a13251f, identifier: PZ31508
2026-03-27 19:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e96dabe3-80e4-569f-b0eb-e9607a13251f with identifier: PZ31508
2026-03-27 19:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e96dabe3-80e4-569f-b0eb-e9607a13251f with identifier: PZ31508
2026-03-27 19:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e96dabe3-80e4-569f-b0eb-e9607a13251f with identifier: PZ31508 to the API
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:26:12Z',
 'fuel_type': 'petrol',
 'id': 'e96dabe3-80e4-569f-b0eb-e9607a13251f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ31508',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 181320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-30',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2006}
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ31508%27 HTTP/1.1" 200 None
2026-03-27 19:11:01 [auto1.nl] INFO: Saving data for PZ31508: {'auction_closing_time': 1774715172.0, 'created_time': 1774440624.90991, 'last_price_update_time': 1774638661.785602}
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PZ31508') HTTP/1.1" 204 0
2026-03-27 19:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:01 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-27 19:11:01 [auto1.nl] INFO: Scrape type for CP17463: 0
2026-03-27 19:11:01 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-27 19:11:01 [auto1.nl] INFO: Scrape type for EJ39658: 0
2026-03-27 19:11:01 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG27565%27 HTTP/1.1" 200 None
2026-03-27 19:11:01 [auto1.nl] INFO: Scrape type for AG27565: 2
2026-03-27 19:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7134b61-2672-54b4-abd9-f5a4036dd684 with identifier: AG27565
2026-03-27 19:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7134b61-2672-54b4-abd9-f5a4036dd684 with scrape type 2
2026-03-27 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7134b61-2672-54b4-abd9-f5a4036dd684 with scrape type 2
2026-03-27 19:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f7134b61-2672-54b4-abd9-f5a4036dd684, identifier: AG27565
2026-03-27 19:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f7134b61-2672-54b4-abd9-f5a4036dd684 with identifier: AG27565
2026-03-27 19:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f7134b61-2672-54b4-abd9-f5a4036dd684 with identifier: AG27565
2026-03-27 19:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f7134b61-2672-54b4-abd9-f5a4036dd684 with identifier: AG27565 to the API
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:36:03Z',
 'fuel_type': 'diesel',
 'id': 'f7134b61-2672-54b4-abd9-f5a4036dd684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG27565',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 151805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-09',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG27565%27 HTTP/1.1" 200 None
2026-03-27 19:11:02 [auto1.nl] INFO: Saving data for AG27565: {'auction_closing_time': 1774715763.0, 'created_time': 1774440698.976316, 'last_price_update_time': 1774638662.194499}
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AG27565') HTTP/1.1" 204 0
2026-03-27 19:11:02 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-27 19:11:02 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-27 19:11:02 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-27 19:11:02 [auto1.nl] INFO: Scrape type for SX35832: 2
2026-03-27 19:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832
2026-03-27 19:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5327012-ac9e-578d-8d90-156cca28f9cd with scrape type 2
2026-03-27 19:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5327012-ac9e-578d-8d90-156cca28f9cd with scrape type 2
2026-03-27 19:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5327012-ac9e-578d-8d90-156cca28f9cd, identifier: SX35832
2026-03-27 19:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP67754> (referer: https://www.auto1.com/v1/car-details-view/SP67754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-27 19:11:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832
2026-03-27 19:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832 to the API
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:04:46Z',
 'fuel_type': 'petrol',
 'id': 'f5327012-ac9e-578d-8d90-156cca28f9cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX35832',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 179932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-21',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2009}
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-27 19:11:02 [auto1.nl] INFO: Saving data for SX35832: {'auction_closing_time': 1774713886.0, 'created_time': 1773229554.129226, 'last_price_update_time': 1774638662.697247}
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SX35832') HTTP/1.1" 204 0
2026-03-27 19:11:02 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF26708%27 HTTP/1.1" 200 None
2026-03-27 19:11:02 [auto1.nl] INFO: Scrape type for RF26708: 2
2026-03-27 19:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade7b98b-d354-575f-b736-9eac58d801e4 with identifier: RF26708
2026-03-27 19:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade7b98b-d354-575f-b736-9eac58d801e4 with scrape type 2
2026-03-27 19:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade7b98b-d354-575f-b736-9eac58d801e4 with scrape type 2
2026-03-27 19:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ade7b98b-d354-575f-b736-9eac58d801e4, identifier: RF26708
2026-03-27 19:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ade7b98b-d354-575f-b736-9eac58d801e4 with identifier: RF26708
2026-03-27 19:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ade7b98b-d354-575f-b736-9eac58d801e4 with identifier: RF26708
2026-03-27 19:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ade7b98b-d354-575f-b736-9eac58d801e4 with identifier: RF26708 to the API
2026-03-27 19:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:40:49Z',
 'fuel_type': 'petrol',
 'id': 'ade7b98b-d354-575f-b736-9eac58d801e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF26708',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 231432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Track & Field 4Motion',
 'transmission': 'manual',
 'trim': 'Track & Field 4Motion',
 'year': 2014}
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF26708%27 HTTP/1.1" 200 None
2026-03-27 19:11:03 [auto1.nl] INFO: Saving data for RF26708: {'auction_closing_time': 1774716049.0, 'created_time': 1773343015.919708, 'last_price_update_time': 1774638663.103877}
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF26708') HTTP/1.1" 204 0
2026-03-27 19:11:03 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-27 19:11:03 [auto1.nl] INFO: Scrape type for LN13615: 0
2026-03-27 19:11:03 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RV40948%27 HTTP/1.1" 200 None
2026-03-27 19:11:03 [auto1.nl] INFO: Scrape type for RV40948: 2
2026-03-27 19:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 820bd508-24ce-5d1e-9b14-32f15d949b1f with identifier: RV40948
2026-03-27 19:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 820bd508-24ce-5d1e-9b14-32f15d949b1f with scrape type 2
2026-03-27 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 820bd508-24ce-5d1e-9b14-32f15d949b1f with scrape type 2
2026-03-27 19:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 820bd508-24ce-5d1e-9b14-32f15d949b1f, identifier: RV40948
2026-03-27 19:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 820bd508-24ce-5d1e-9b14-32f15d949b1f with identifier: RV40948
2026-03-27 19:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 820bd508-24ce-5d1e-9b14-32f15d949b1f with identifier: RV40948
2026-03-27 19:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 820bd508-24ce-5d1e-9b14-32f15d949b1f with identifier: RV40948 to the API
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:06Z',
 'fuel_type': 'petrol',
 'id': '820bd508-24ce-5d1e-9b14-32f15d949b1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV40948',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 88290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-20',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
 'transmission': 'automatic',
 'trim': 'sport',
 'year': 2018}
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RV40948%27 HTTP/1.1" 200 None
2026-03-27 19:11:03 [auto1.nl] INFO: Saving data for RV40948: {'auction_closing_time': 1774714686.0, 'created_time': 1773229232.392697, 'last_price_update_time': 1774638663.560417}
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RV40948') HTTP/1.1" 204 0
2026-03-27 19:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1 with identifier: SP67754
2026-03-27 19:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1 with scrape type 1
2026-03-27 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_cf2edb27250d175f46b868a93e8dc4ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_cf2edb27250d175f46b868a93e8dc4ca.jpg not downloaded yet
2026-03-27 19:11:03 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV80682%27 HTTP/1.1" 200 None
2026-03-27 19:11:03 [auto1.nl] INFO: Scrape type for CV80682: 0
2026-03-27 19:11:03 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP01312%27 HTTP/1.1" 200 None
2026-03-27 19:11:03 [auto1.nl] INFO: Scrape type for EP01312: 2
2026-03-27 19:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48b083c7-3431-5cb0-9ab3-606c38d02ccd with identifier: EP01312
2026-03-27 19:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b083c7-3431-5cb0-9ab3-606c38d02ccd with scrape type 2
2026-03-27 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48b083c7-3431-5cb0-9ab3-606c38d02ccd with scrape type 2
2026-03-27 19:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 48b083c7-3431-5cb0-9ab3-606c38d02ccd, identifier: EP01312
2026-03-27 19:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 48b083c7-3431-5cb0-9ab3-606c38d02ccd with identifier: EP01312
2026-03-27 19:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 48b083c7-3431-5cb0-9ab3-606c38d02ccd with identifier: EP01312
2026-03-27 19:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 48b083c7-3431-5cb0-9ab3-606c38d02ccd with identifier: EP01312 to the API
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:49:42Z',
 'fuel_type': 'diesel',
 'id': '48b083c7-3431-5cb0-9ab3-606c38d02ccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP01312',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 341505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-04',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP01312%27 HTTP/1.1" 200 None
2026-03-27 19:11:04 [auto1.nl] INFO: Saving data for EP01312: {'auction_closing_time': 1774716582.0, 'created_time': 1774465823.660366, 'last_price_update_time': 1774638664.048698}
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EP01312') HTTP/1.1" 204 0
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_8feb4f512292b02959038ff5131c6cb5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_8feb4f512292b02959038ff5131c6cb5.jpg not downloaded yet
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-27 19:11:04 [auto1.nl] INFO: Scrape type for CR08212: 2
2026-03-27 19:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d829a7de-4dce-5c27-8289-119c2fd59541 with identifier: CR08212
2026-03-27 19:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d829a7de-4dce-5c27-8289-119c2fd59541 with scrape type 2
2026-03-27 19:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d829a7de-4dce-5c27-8289-119c2fd59541 with scrape type 2
2026-03-27 19:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d829a7de-4dce-5c27-8289-119c2fd59541, identifier: CR08212
2026-03-27 19:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d829a7de-4dce-5c27-8289-119c2fd59541 with identifier: CR08212
2026-03-27 19:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d829a7de-4dce-5c27-8289-119c2fd59541 with identifier: CR08212
2026-03-27 19:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d829a7de-4dce-5c27-8289-119c2fd59541 with identifier: CR08212 to the API
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:30:53Z',
 'fuel_type': 'petrol',
 'id': 'd829a7de-4dce-5c27-8289-119c2fd59541',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR08212',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 106676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2017}
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-27 19:11:04 [auto1.nl] INFO: Saving data for CR08212: {'auction_closing_time': 1774715453.0, 'created_time': 1773301505.083181, 'last_price_update_time': 1774638664.461053}
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR08212') HTTP/1.1" 204 0
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_f8a9ee96b8a26bfdcb4c9290b5e1246f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_f8a9ee96b8a26bfdcb4c9290b5e1246f.jpg not downloaded yet
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD71761%27 HTTP/1.1" 200 None
2026-03-27 19:11:04 [auto1.nl] INFO: Scrape type for BD71761: 0
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-27 19:11:04 [auto1.nl] INFO: Scrape type for RD50492: 0
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU65627%27 HTTP/1.1" 200 None
2026-03-27 19:11:04 [auto1.nl] INFO: Scrape type for UU65627: 0
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-27 19:11:04 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-27 19:11:04 [auto1.nl] INFO: Scrape type for FA26024: 2
2026-03-27 19:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d6a555-0950-5050-a757-4e98e1227bad with identifier: FA26024
2026-03-27 19:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d6a555-0950-5050-a757-4e98e1227bad with scrape type 2
2026-03-27 19:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46d6a555-0950-5050-a757-4e98e1227bad with scrape type 2
2026-03-27 19:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 46d6a555-0950-5050-a757-4e98e1227bad, identifier: FA26024
2026-03-27 19:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 46d6a555-0950-5050-a757-4e98e1227bad with identifier: FA26024
2026-03-27 19:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 46d6a555-0950-5050-a757-4e98e1227bad with identifier: FA26024
2026-03-27 19:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 46d6a555-0950-5050-a757-4e98e1227bad with identifier: FA26024 to the API
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:02:27Z',
 'fuel_type': 'petrol',
 'id': '46d6a555-0950-5050-a757-4e98e1227bad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA26024',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 102390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-30',
 'seller_name': None,
 'title': 'Citroen C3 1.1 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2005}
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-27 19:11:05 [auto1.nl] INFO: Saving data for FA26024: {'auction_closing_time': 1774713747.0, 'created_time': 1774552227.725255, 'last_price_update_time': 1774638665.071915}
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FA26024') HTTP/1.1" 204 0
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_de7be2b3469ceac70ddf3014628e0b86.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_de7be2b3469ceac70ddf3014628e0b86.jpg not downloaded yet
2026-03-27 19:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_cf2edb27250d175f46b868a93e8dc4ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:05 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-27 19:11:05 [auto1.nl] INFO: Scrape type for ZY88945: 2
2026-03-27 19:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945
2026-03-27 19:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86f80907-8290-5b49-b95c-ebc0855b07fe with scrape type 2
2026-03-27 19:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86f80907-8290-5b49-b95c-ebc0855b07fe with scrape type 2
2026-03-27 19:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 86f80907-8290-5b49-b95c-ebc0855b07fe, identifier: ZY88945
2026-03-27 19:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945
2026-03-27 19:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945
2026-03-27 19:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945 to the API
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:24:30Z',
 'fuel_type': 'petrol',
 'id': '86f80907-8290-5b49-b95c-ebc0855b07fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY88945',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 221775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-31',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 R-Design 2WD',
 'transmission': 'manual',
 'trim': 'R-Design 2WD',
 'year': 2012}
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-27 19:11:05 [auto1.nl] INFO: Saving data for ZY88945: {'auction_closing_time': 1774715070.0, 'created_time': 1773131940.100476, 'last_price_update_time': 1774638665.58785}
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZY88945') HTTP/1.1" 204 0
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_56292b008e1f05c4c4f5659b37a7b190.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_56292b008e1f05c4c4f5659b37a7b190.jpg not downloaded yet
2026-03-27 19:11:05 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-27 19:11:05 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-27 19:11:05 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX68417%27 HTTP/1.1" 200 None
2026-03-27 19:11:05 [auto1.nl] INFO: Scrape type for BX68417: 0
2026-03-27 19:11:05 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-27 19:11:05 [auto1.nl] INFO: Scrape type for JG11787: 2
2026-03-27 19:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a48a363-e345-5c36-8c80-6b79d093f906 with identifier: JG11787
2026-03-27 19:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a48a363-e345-5c36-8c80-6b79d093f906 with scrape type 2
2026-03-27 19:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a48a363-e345-5c36-8c80-6b79d093f906 with scrape type 2
2026-03-27 19:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7a48a363-e345-5c36-8c80-6b79d093f906, identifier: JG11787
2026-03-27 19:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_8feb4f512292b02959038ff5131c6cb5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7a48a363-e345-5c36-8c80-6b79d093f906 with identifier: JG11787
2026-03-27 19:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7a48a363-e345-5c36-8c80-6b79d093f906 with identifier: JG11787
2026-03-27 19:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7a48a363-e345-5c36-8c80-6b79d093f906 with identifier: JG11787 to the API
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:25:25Z',
 'fuel_type': 'diesel',
 'id': '7a48a363-e345-5c36-8c80-6b79d093f906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG11787',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 125645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Active Business",
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2021}
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-27 19:11:06 [auto1.nl] INFO: Saving data for JG11787: {'auction_closing_time': 1774715125.0, 'created_time': 1774552223.848903, 'last_price_update_time': 1774638666.02949}
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JG11787') HTTP/1.1" 204 0
2026-03-27 19:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_f8a9ee96b8a26bfdcb4c9290b5e1246f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY95005%27 HTTP/1.1" 200 None
2026-03-27 19:11:06 [auto1.nl] INFO: Scrape type for NY95005: 2
2026-03-27 19:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 345f929c-47dd-5467-848f-f4c482f84bbe with identifier: NY95005
2026-03-27 19:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 345f929c-47dd-5467-848f-f4c482f84bbe with scrape type 2
2026-03-27 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 345f929c-47dd-5467-848f-f4c482f84bbe with scrape type 2
2026-03-27 19:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 345f929c-47dd-5467-848f-f4c482f84bbe, identifier: NY95005
2026-03-27 19:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3467f50>
2026-03-27 19:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_cf2edb27250d175f46b868a93e8dc4ca.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_cf2edb27250d175f46b868a93e8dc4ca.jpg saved to cache
2026-03-27 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1
2026-03-27 19:11:06 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 916 | hits on page: 40
2026-03-27 19:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 345f929c-47dd-5467-848f-f4c482f84bbe with identifier: NY95005
2026-03-27 19:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 345f929c-47dd-5467-848f-f4c482f84bbe with identifier: NY95005
2026-03-27 19:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 345f929c-47dd-5467-848f-f4c482f84bbe with identifier: NY95005 to the API
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:36:39Z',
 'fuel_type': 'petrol',
 'id': '345f929c-47dd-5467-848f-f4c482f84bbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY95005',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 188452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-25',
 'seller_name': None,
 'title': 'Volvo S60 2.0 B3 Mild-Hybrid R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2021}
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY95005%27 HTTP/1.1" 200 None
2026-03-27 19:11:06 [auto1.nl] INFO: Saving data for NY95005: {'auction_closing_time': 1774715799.0, 'created_time': 1774440698.041504, 'last_price_update_time': 1774638666.468898}
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY95005') HTTP/1.1" 204 0
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY33770%27 HTTP/1.1" 200 None
2026-03-27 19:11:06 [auto1.nl] INFO: Scrape type for BY33770: 0
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-27 19:11:06 [auto1.nl] INFO: Scrape type for RT17278: 0
2026-03-27 19:11:06 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE36776%27 HTTP/1.1" 200 None
2026-03-27 19:11:06 [auto1.nl] INFO: Scrape type for YE36776: 2
2026-03-27 19:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0d0ba34-e7cf-52f2-9185-84c92230d36a with identifier: YE36776
2026-03-27 19:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0d0ba34-e7cf-52f2-9185-84c92230d36a with scrape type 2
2026-03-27 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0d0ba34-e7cf-52f2-9185-84c92230d36a with scrape type 2
2026-03-27 19:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b0d0ba34-e7cf-52f2-9185-84c92230d36a, identifier: YE36776
2026-03-27 19:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35ead10>
2026-03-27 19:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_8feb4f512292b02959038ff5131c6cb5.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_8feb4f512292b02959038ff5131c6cb5.jpg saved to cache
2026-03-27 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1
2026-03-27 19:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_de7be2b3469ceac70ddf3014628e0b86.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b0d0ba34-e7cf-52f2-9185-84c92230d36a with identifier: YE36776
2026-03-27 19:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b0d0ba34-e7cf-52f2-9185-84c92230d36a with identifier: YE36776
2026-03-27 19:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b0d0ba34-e7cf-52f2-9185-84c92230d36a with identifier: YE36776 to the API
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:16:53Z',
 'fuel_type': 'petrol',
 'id': 'b0d0ba34-e7cf-52f2-9185-84c92230d36a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE36776',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 152855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE36776%27 HTTP/1.1" 200 None
2026-03-27 19:11:06 [auto1.nl] INFO: Saving data for YE36776: {'auction_closing_time': 1774714613.0, 'created_time': 1774440637.262069, 'last_price_update_time': 1774638666.932821}
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YE36776') HTTP/1.1" 204 0
2026-03-27 19:11:07 [scrapy.extensions.logstats] INFO: Crawled 49 pages (at 49 pages/min), scraped 75 items (at 75 items/min)
2026-03-27 19:11:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 19:11:07 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-27 19:11:07 [auto1.nl] INFO: Scrape type for TE70578: 1
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae333aed0>
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_f8a9ee96b8a26bfdcb4c9290b5e1246f.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_f8a9ee96b8a26bfdcb4c9290b5e1246f.jpg saved to cache
2026-03-27 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1
2026-03-27 19:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_56292b008e1f05c4c4f5659b37a7b190.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:07 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-27 19:11:07 [auto1.nl] INFO: Scrape type for CT01963: 2
2026-03-27 19:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with identifier: CT01963
2026-03-27 19:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with scrape type 2
2026-03-27 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with scrape type 2
2026-03-27 19:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8, identifier: CT01963
2026-03-27 19:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with identifier: CT01963
2026-03-27 19:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with identifier: CT01963
2026-03-27 19:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with identifier: CT01963 to the API
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:08:37Z',
 'fuel_type': 'petrol',
 'id': '3818301d-8d5a-5264-97ab-7dbbb1fa02c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT01963',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 35324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-13',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2021}
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-27 19:11:07 [auto1.nl] INFO: Saving data for CT01963: {'auction_closing_time': 1774714117.0, 'created_time': 1774552261.027983, 'last_price_update_time': 1774638667.443535}
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT01963') HTTP/1.1" 204 0
2026-03-27 19:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35ce350>
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_de7be2b3469ceac70ddf3014628e0b86.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_de7be2b3469ceac70ddf3014628e0b86.jpg saved to cache
2026-03-27 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1
2026-03-27 19:11:07 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-27 19:11:07 [auto1.nl] INFO: Scrape type for EM54492: 2
2026-03-27 19:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with identifier: EM54492
2026-03-27 19:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with scrape type 2
2026-03-27 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with scrape type 2
2026-03-27 19:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444, identifier: EM54492
2026-03-27 19:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with identifier: EM54492
2026-03-27 19:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with identifier: EM54492
2026-03-27 19:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with identifier: EM54492 to the API
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:18:38Z',
 'fuel_type': 'diesel',
 'id': '60be9cbe-b38b-5fd8-b3ee-b90f1ea78444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM54492',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 192254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-28',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2008}
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-27 19:11:07 [auto1.nl] INFO: Saving data for EM54492: {'auction_closing_time': 1774714718.0, 'created_time': 1774552222.096869, 'last_price_update_time': 1774638667.857198}
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM54492') HTTP/1.1" 204 0
2026-03-27 19:11:07 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-27 19:11:07 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-27 19:11:07 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS92650%27 HTTP/1.1" 200 None
2026-03-27 19:11:07 [auto1.nl] INFO: Scrape type for TS92650: 2
2026-03-27 19:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b161ce3-5818-5169-ba67-b66351309894 with identifier: TS92650
2026-03-27 19:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b161ce3-5818-5169-ba67-b66351309894 with scrape type 2
2026-03-27 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b161ce3-5818-5169-ba67-b66351309894 with scrape type 2
2026-03-27 19:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1b161ce3-5818-5169-ba67-b66351309894, identifier: TS92650
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3389290>
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fad%252F4aad88b2bb70033063d685df1b55006a%252Fpa%252FSP67754_56292b008e1f05c4c4f5659b37a7b190.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_56292b008e1f05c4c4f5659b37a7b190.jpg saved to cache
2026-03-27 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1
2026-03-27 19:11:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1, skipping ID generation
2026-03-27 19:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1 with scrape type 1
2026-03-27 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1 sending to next pipeline
2026-03-27 19:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1, identifier: SP67754
2026-03-27 19:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1b161ce3-5818-5169-ba67-b66351309894 with identifier: TS92650
2026-03-27 19:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1b161ce3-5818-5169-ba67-b66351309894 with identifier: TS92650
2026-03-27 19:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1b161ce3-5818-5169-ba67-b66351309894 with identifier: TS92650 to the API
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:34Z',
 'fuel_type': 'petrol',
 'id': '1b161ce3-5818-5169-ba67-b66351309894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS92650',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 109576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-11',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS92650%27 HTTP/1.1" 200 None
2026-03-27 19:11:08 [auto1.nl] INFO: Saving data for TS92650: {'auction_closing_time': 1774716994.0, 'created_time': 1774440667.637441, 'last_price_update_time': 1774638668.352935}
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TS92650') HTTP/1.1" 204 0
2026-03-27 19:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1 with identifier: SP67754
2026-03-27 19:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1 with identifier: SP67754
2026-03-27 19:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1 with identifier: SP67754 to the API
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_56292b008e1f05c4c4f5659b37a7b190.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:40:19Z',
 'fuel_type': 'petrol',
 'id': '0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '37XKRL',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP67754',
 'listing': 'auction',
 'location': 'NL, Apeldoorn',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 107485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_cf2edb27250d175f46b868a93e8dc4ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_8feb4f512292b02959038ff5131c6cb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_f8a9ee96b8a26bfdcb4c9290b5e1246f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_de7be2b3469ceac70ddf3014628e0b86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1/0c9f2e5a-e1d9-5fdc-900f-78ded16fc4d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ad/4aad88b2bb70033063d685df1b55006a/pa/SP67754_56292b008e1f05c4c4f5659b37a7b190.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 XS Pack',
 'transmission': 'automatic',
 'trim': 'XS Pack',
 'year': 2007}
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SP67754%27 HTTP/1.1" 200 None
2026-03-27 19:11:08 [auto1.nl] INFO: Saving data for SP67754: {'created_time': 1774638668.71244, 'last_price_update_time': 1774638668.712452, 'auction_closing_time': 1774716019.0}
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SP67754') HTTP/1.1" 204 0
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW78376%27 HTTP/1.1" 200 None
2026-03-27 19:11:08 [auto1.nl] INFO: Scrape type for YW78376: 0
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW41282%27 HTTP/1.1" 200 None
2026-03-27 19:11:08 [auto1.nl] INFO: Scrape type for SW41282: 0
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ22600%27 HTTP/1.1" 200 None
2026-03-27 19:11:08 [auto1.nl] INFO: Scrape type for PZ22600: 0
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN28689%27 HTTP/1.1" 200 None
2026-03-27 19:11:08 [auto1.nl] INFO: Scrape type for BN28689: 0
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-27 19:11:08 [auto1.nl] INFO: Scrape type for MD57319: 0
2026-03-27 19:11:08 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-27 19:11:08 [auto1.nl] INFO: Scrape type for GB93242: 2
2026-03-27 19:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4023467b-c0c8-5c07-a86f-2d364e5924f9 with identifier: GB93242
2026-03-27 19:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4023467b-c0c8-5c07-a86f-2d364e5924f9 with scrape type 2
2026-03-27 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4023467b-c0c8-5c07-a86f-2d364e5924f9 with scrape type 2
2026-03-27 19:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4023467b-c0c8-5c07-a86f-2d364e5924f9, identifier: GB93242
2026-03-27 19:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4023467b-c0c8-5c07-a86f-2d364e5924f9 with identifier: GB93242
2026-03-27 19:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4023467b-c0c8-5c07-a86f-2d364e5924f9 with identifier: GB93242
2026-03-27 19:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4023467b-c0c8-5c07-a86f-2d364e5924f9 with identifier: GB93242 to the API
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:16:03Z',
 'fuel_type': 'hybrid',
 'id': '4023467b-c0c8-5c07-a86f-2d364e5924f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB93242',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-27 19:11:09 [auto1.nl] INFO: Saving data for GB93242: {'auction_closing_time': 1774714563.0, 'created_time': 1774552221.224892, 'last_price_update_time': 1774638669.196748}
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GB93242') HTTP/1.1" 204 0
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK48888%27 HTTP/1.1" 200 None
2026-03-27 19:11:09 [auto1.nl] INFO: Scrape type for CK48888: 2
2026-03-27 19:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf72389-9e60-50cf-b6f3-9f7b2a218781 with identifier: CK48888
2026-03-27 19:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf72389-9e60-50cf-b6f3-9f7b2a218781 with scrape type 2
2026-03-27 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf72389-9e60-50cf-b6f3-9f7b2a218781 with scrape type 2
2026-03-27 19:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4bf72389-9e60-50cf-b6f3-9f7b2a218781, identifier: CK48888
2026-03-27 19:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4bf72389-9e60-50cf-b6f3-9f7b2a218781 with identifier: CK48888
2026-03-27 19:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4bf72389-9e60-50cf-b6f3-9f7b2a218781 with identifier: CK48888
2026-03-27 19:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4bf72389-9e60-50cf-b6f3-9f7b2a218781 with identifier: CK48888 to the API
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:31:06Z',
 'fuel_type': 'petrol',
 'id': '4bf72389-9e60-50cf-b6f3-9f7b2a218781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK48888',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 137515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-14',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK48888%27 HTTP/1.1" 200 None
2026-03-27 19:11:09 [auto1.nl] INFO: Saving data for CK48888: {'auction_closing_time': 1774715466.0, 'created_time': 1773302435.242048, 'last_price_update_time': 1774638669.683348}
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CK48888') HTTP/1.1" 204 0
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-27 19:11:09 [auto1.nl] INFO: Scrape type for GD99184: 1
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV32142%27 HTTP/1.1" 200 None
2026-03-27 19:11:09 [auto1.nl] INFO: Scrape type for WV32142: 0
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-27 19:11:09 [auto1.nl] INFO: Scrape type for DU88284: 0
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-27 19:11:09 [auto1.nl] INFO: Scrape type for WC97739: 0
2026-03-27 19:11:09 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC21923%27 HTTP/1.1" 200 None
2026-03-27 19:11:09 [auto1.nl] INFO: Scrape type for MC21923: 2
2026-03-27 19:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca7f5e9-ffc1-5917-ac89-2d9eb2ad0189 with identifier: MC21923
2026-03-27 19:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca7f5e9-ffc1-5917-ac89-2d9eb2ad0189 with scrape type 2
2026-03-27 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eca7f5e9-ffc1-5917-ac89-2d9eb2ad0189 with scrape type 2
2026-03-27 19:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eca7f5e9-ffc1-5917-ac89-2d9eb2ad0189, identifier: MC21923
2026-03-27 19:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eca7f5e9-ffc1-5917-ac89-2d9eb2ad0189 with identifier: MC21923
2026-03-27 19:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eca7f5e9-ffc1-5917-ac89-2d9eb2ad0189 with identifier: MC21923
2026-03-27 19:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eca7f5e9-ffc1-5917-ac89-2d9eb2ad0189 with identifier: MC21923 to the API
2026-03-27 19:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:50:01Z',
 'fuel_type': 'diesel',
 'id': 'eca7f5e9-ffc1-5917-ac89-2d9eb2ad0189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC21923',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 258937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-24',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten CoolProfi',
 'transmission': 'automatic',
 'trim': 'Kasten CoolProfi',
 'year': 2015}
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC21923%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Saving data for MC21923: {'auction_closing_time': 1774716601.0, 'created_time': 1774440715.106747, 'last_price_update_time': 1774638670.144576}
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MC21923') HTTP/1.1" 204 0
2026-03-27 19:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK82229%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Scrape type for AK82229: 0
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Scrape type for ZL38920: 0
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD16016%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Scrape type for FD16016: 0
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX54730%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Scrape type for NX54730: 0
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ22754%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Scrape type for HZ22754: 2
2026-03-27 19:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12734071-41ca-5e61-ac85-b4a3e87b3a02 with identifier: HZ22754
2026-03-27 19:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12734071-41ca-5e61-ac85-b4a3e87b3a02 with scrape type 2
2026-03-27 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12734071-41ca-5e61-ac85-b4a3e87b3a02 with scrape type 2
2026-03-27 19:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 12734071-41ca-5e61-ac85-b4a3e87b3a02, identifier: HZ22754
2026-03-27 19:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 12734071-41ca-5e61-ac85-b4a3e87b3a02 with identifier: HZ22754
2026-03-27 19:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 12734071-41ca-5e61-ac85-b4a3e87b3a02 with identifier: HZ22754
2026-03-27 19:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 12734071-41ca-5e61-ac85-b4a3e87b3a02 with identifier: HZ22754 to the API
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:56:42Z',
 'fuel_type': 'diesel',
 'id': '12734071-41ca-5e61-ac85-b4a3e87b3a02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ22754',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 58440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi GT L1',
 'transmission': 'manual',
 'trim': 'GT L1',
 'year': 2021}
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ22754%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Saving data for HZ22754: {'auction_closing_time': 1774717002.0, 'created_time': 1773133333.571338, 'last_price_update_time': 1774638670.715466}
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HZ22754') HTTP/1.1" 204 0
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC55354%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Scrape type for FC55354: 0
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92567%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Scrape type for UU92567: 0
2026-03-27 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE70578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:10 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 916 | hits on page: 40
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-27 19:11:10 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD69435%27 HTTP/1.1" 200 None
2026-03-27 19:11:10 [auto1.nl] INFO: Scrape type for SD69435: 2
2026-03-27 19:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb4fa27e-17fb-562e-8368-5c99e53c6449 with identifier: SD69435
2026-03-27 19:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb4fa27e-17fb-562e-8368-5c99e53c6449 with scrape type 2
2026-03-27 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb4fa27e-17fb-562e-8368-5c99e53c6449 with scrape type 2
2026-03-27 19:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cb4fa27e-17fb-562e-8368-5c99e53c6449, identifier: SD69435
2026-03-27 19:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cb4fa27e-17fb-562e-8368-5c99e53c6449 with identifier: SD69435
2026-03-27 19:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cb4fa27e-17fb-562e-8368-5c99e53c6449 with identifier: SD69435
2026-03-27 19:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cb4fa27e-17fb-562e-8368-5c99e53c6449 with identifier: SD69435 to the API
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:25:07Z',
 'fuel_type': 'petrol',
 'id': 'cb4fa27e-17fb-562e-8368-5c99e53c6449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD69435',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 154116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-25',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD69435%27 HTTP/1.1" 200 None
2026-03-27 19:11:11 [auto1.nl] INFO: Saving data for SD69435: {'auction_closing_time': 1774715107.0, 'created_time': 1774440672.763592, 'last_price_update_time': 1774638671.275851}
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD69435') HTTP/1.1" 204 0
2026-03-27 19:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:11 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD75991%27 HTTP/1.1" 200 None
2026-03-27 19:11:11 [auto1.nl] INFO: Scrape type for LD75991: 2
2026-03-27 19:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa0ef91c-ae46-524f-8a75-6899881554e2 with identifier: LD75991
2026-03-27 19:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa0ef91c-ae46-524f-8a75-6899881554e2 with scrape type 2
2026-03-27 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa0ef91c-ae46-524f-8a75-6899881554e2 with scrape type 2
2026-03-27 19:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aa0ef91c-ae46-524f-8a75-6899881554e2, identifier: LD75991
2026-03-27 19:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aa0ef91c-ae46-524f-8a75-6899881554e2 with identifier: LD75991
2026-03-27 19:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aa0ef91c-ae46-524f-8a75-6899881554e2 with identifier: LD75991
2026-03-27 19:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aa0ef91c-ae46-524f-8a75-6899881554e2 with identifier: LD75991 to the API
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:55:05Z',
 'fuel_type': 'petrol',
 'id': 'aa0ef91c-ae46-524f-8a75-6899881554e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD75991',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 133297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD75991%27 HTTP/1.1" 200 None
2026-03-27 19:11:11 [auto1.nl] INFO: Saving data for LD75991: {'auction_closing_time': 1774716905.0, 'created_time': 1774440649.359072, 'last_price_update_time': 1774638671.651685}
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LD75991') HTTP/1.1" 204 0
2026-03-27 19:11:11 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-27 19:11:11 [auto1.nl] INFO: Scrape type for CL54405: 0
2026-03-27 19:11:11 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ31369%27 HTTP/1.1" 200 None
2026-03-27 19:11:11 [auto1.nl] INFO: Scrape type for CJ31369: 0
2026-03-27 19:11:11 [auto1.nl] INFO: Found listing with ID: WV84251
2026-03-27 19:11:11 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-27 19:11:11 [auto1.nl] INFO: Scrape type for MD55137: 0
2026-03-27 19:11:11 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-27 19:11:11 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-27 19:11:11 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-27 19:11:11 [auto1.nl] INFO: Scrape type for ZE21436: 2
2026-03-27 19:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436
2026-03-27 19:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with scrape type 2
2026-03-27 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with scrape type 2
2026-03-27 19:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b, identifier: ZE21436
2026-03-27 19:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436
2026-03-27 19:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436
2026-03-27 19:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436 to the API
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:11:29Z',
 'fuel_type': 'diesel',
 'id': '4ce19f29-2e87-5963-808e-a7e3eb7d2d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE21436',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 178348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-11-06',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 Diesel Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 1997}
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-27 19:11:12 [auto1.nl] INFO: Saving data for ZE21436: {'auction_closing_time': 1774714289.0, 'created_time': 1774465847.593938, 'last_price_update_time': 1774638672.181733}
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE21436') HTTP/1.1" 204 0
2026-03-27 19:11:12 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-27 19:11:12 [auto1.nl] INFO: Scrape type for TU57635: 0
2026-03-27 19:11:12 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-27 19:11:12 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-27 19:11:12 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ77908%27 HTTP/1.1" 200 None
2026-03-27 19:11:12 [auto1.nl] INFO: Scrape type for LJ77908: 2
2026-03-27 19:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dc65aeb-1b46-5e3f-b82c-a245ace1ccbb with identifier: LJ77908
2026-03-27 19:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dc65aeb-1b46-5e3f-b82c-a245ace1ccbb with scrape type 2
2026-03-27 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dc65aeb-1b46-5e3f-b82c-a245ace1ccbb with scrape type 2
2026-03-27 19:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6dc65aeb-1b46-5e3f-b82c-a245ace1ccbb, identifier: LJ77908
2026-03-27 19:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6dc65aeb-1b46-5e3f-b82c-a245ace1ccbb with identifier: LJ77908
2026-03-27 19:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6dc65aeb-1b46-5e3f-b82c-a245ace1ccbb with identifier: LJ77908
2026-03-27 19:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6dc65aeb-1b46-5e3f-b82c-a245ace1ccbb with identifier: LJ77908 to the API
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:10Z',
 'fuel_type': 'petrol',
 'id': '6dc65aeb-1b46-5e3f-b82c-a245ace1ccbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ77908',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 132687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-19',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo 120 Jahre Start/Stop',
 'transmission': 'automatic',
 'trim': '120 Jahre Start/Stop',
 'year': 2019}
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ77908%27 HTTP/1.1" 200 None
2026-03-27 19:11:12 [auto1.nl] INFO: Saving data for LJ77908: {'auction_closing_time': 1774717150.0, 'created_time': 1774440697.664458, 'last_price_update_time': 1774638672.593704}
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LJ77908') HTTP/1.1" 204 0
2026-03-27 19:11:12 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS89780%27 HTTP/1.1" 200 None
2026-03-27 19:11:12 [auto1.nl] INFO: Scrape type for GS89780: 2
2026-03-27 19:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b308922d-986d-5ffc-a69e-9a55de2533c2 with identifier: GS89780
2026-03-27 19:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b308922d-986d-5ffc-a69e-9a55de2533c2 with scrape type 2
2026-03-27 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b308922d-986d-5ffc-a69e-9a55de2533c2 with scrape type 2
2026-03-27 19:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b308922d-986d-5ffc-a69e-9a55de2533c2, identifier: GS89780
2026-03-27 19:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b308922d-986d-5ffc-a69e-9a55de2533c2 with identifier: GS89780
2026-03-27 19:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b308922d-986d-5ffc-a69e-9a55de2533c2 with identifier: GS89780
2026-03-27 19:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b308922d-986d-5ffc-a69e-9a55de2533c2 with identifier: GS89780 to the API
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:54:47Z',
 'fuel_type': 'hybrid',
 'id': 'b308922d-986d-5ffc-a69e-9a55de2533c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS89780',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 258253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS89780%27 HTTP/1.1" 200 None
2026-03-27 19:11:13 [auto1.nl] INFO: Saving data for GS89780: {'auction_closing_time': 1774716887.0, 'created_time': 1774440629.374, 'last_price_update_time': 1774638673.09613}
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GS89780') HTTP/1.1" 204 0
2026-03-27 19:11:13 [auto1.nl] INFO: Found listing with ID: VA86988
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA86988%27 HTTP/1.1" 200 None
2026-03-27 19:11:13 [auto1.nl] INFO: Scrape type for VA86988: 2
2026-03-27 19:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: becb22e6-451d-50e7-a082-db4b4bb3c33a with identifier: VA86988
2026-03-27 19:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item becb22e6-451d-50e7-a082-db4b4bb3c33a with scrape type 2
2026-03-27 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item becb22e6-451d-50e7-a082-db4b4bb3c33a with scrape type 2
2026-03-27 19:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: becb22e6-451d-50e7-a082-db4b4bb3c33a, identifier: VA86988
2026-03-27 19:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD99184/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: becb22e6-451d-50e7-a082-db4b4bb3c33a with identifier: VA86988
2026-03-27 19:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: becb22e6-451d-50e7-a082-db4b4bb3c33a with identifier: VA86988
2026-03-27 19:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: becb22e6-451d-50e7-a082-db4b4bb3c33a with identifier: VA86988 to the API
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:49:44Z',
 'fuel_type': 'hybrid',
 'id': 'becb22e6-451d-50e7-a082-db4b4bb3c33a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA86988',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA86988%27 HTTP/1.1" 200 None
2026-03-27 19:11:13 [auto1.nl] INFO: Saving data for VA86988: {'auction_closing_time': 1774716584.0, 'created_time': 1773342945.351641, 'last_price_update_time': 1774638673.47008}
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA86988') HTTP/1.1" 204 0
2026-03-27 19:11:13 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-27 19:11:13 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-27 19:11:13 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-27 19:11:13 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-27 19:11:13 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD32446%27 HTTP/1.1" 200 None
2026-03-27 19:11:13 [auto1.nl] INFO: Scrape type for XD32446: 0
2026-03-27 19:11:13 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XB72700%27 HTTP/1.1" 200 None
2026-03-27 19:11:13 [auto1.nl] INFO: Scrape type for XB72700: 2
2026-03-27 19:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07796a48-3620-5f7f-a238-b785c7bce3de with identifier: XB72700
2026-03-27 19:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07796a48-3620-5f7f-a238-b785c7bce3de with scrape type 2
2026-03-27 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07796a48-3620-5f7f-a238-b785c7bce3de with scrape type 2
2026-03-27 19:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 07796a48-3620-5f7f-a238-b785c7bce3de, identifier: XB72700
2026-03-27 19:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 07796a48-3620-5f7f-a238-b785c7bce3de with identifier: XB72700
2026-03-27 19:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 07796a48-3620-5f7f-a238-b785c7bce3de with identifier: XB72700
2026-03-27 19:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 07796a48-3620-5f7f-a238-b785c7bce3de with identifier: XB72700 to the API
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:15:37Z',
 'fuel_type': 'petrol',
 'id': '07796a48-3620-5f7f-a238-b785c7bce3de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB72700',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 149237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-07',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2021}
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XB72700%27 HTTP/1.1" 200 None
2026-03-27 19:11:13 [auto1.nl] INFO: Saving data for XB72700: {'auction_closing_time': 1774714537.0, 'created_time': 1774440701.790603, 'last_price_update_time': 1774638673.883671}
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XB72700') HTTP/1.1" 204 0
2026-03-27 19:11:13 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX44669%27 HTTP/1.1" 200 None
2026-03-27 19:11:13 [auto1.nl] INFO: Scrape type for AX44669: 2
2026-03-27 19:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee7fed79-3142-545f-aa97-17fcf4c1e580 with identifier: AX44669
2026-03-27 19:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee7fed79-3142-545f-aa97-17fcf4c1e580 with scrape type 2
2026-03-27 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee7fed79-3142-545f-aa97-17fcf4c1e580 with scrape type 2
2026-03-27 19:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ee7fed79-3142-545f-aa97-17fcf4c1e580, identifier: AX44669
2026-03-27 19:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ee7fed79-3142-545f-aa97-17fcf4c1e580 with identifier: AX44669
2026-03-27 19:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ee7fed79-3142-545f-aa97-17fcf4c1e580 with identifier: AX44669
2026-03-27 19:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ee7fed79-3142-545f-aa97-17fcf4c1e580 with identifier: AX44669 to the API
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:56:30Z',
 'fuel_type': 'petrol',
 'id': 'ee7fed79-3142-545f-aa97-17fcf4c1e580',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX44669',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 201909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-15',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2013}
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX44669%27 HTTP/1.1" 200 None
2026-03-27 19:11:14 [auto1.nl] INFO: Saving data for AX44669: {'auction_closing_time': 1774716990.0, 'created_time': 1774440693.204999, 'last_price_update_time': 1774638674.268756}
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX44669') HTTP/1.1" 204 0
2026-03-27 19:11:14 [auto1.nl] INFO: Found listing with ID: FZ55104
2026-03-27 19:11:14 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-27 19:11:14 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV41758%27 HTTP/1.1" 200 None
2026-03-27 19:11:14 [auto1.nl] INFO: Scrape type for XV41758: 0
2026-03-27 19:11:14 [auto1.nl] INFO: Found listing with ID: AN32414
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN32414%27 HTTP/1.1" 200 None
2026-03-27 19:11:14 [auto1.nl] INFO: Scrape type for AN32414: 2
2026-03-27 19:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befdcefa-4603-5081-b9fa-9a2e80bc5c01 with identifier: AN32414
2026-03-27 19:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befdcefa-4603-5081-b9fa-9a2e80bc5c01 with scrape type 2
2026-03-27 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item befdcefa-4603-5081-b9fa-9a2e80bc5c01 with scrape type 2
2026-03-27 19:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: befdcefa-4603-5081-b9fa-9a2e80bc5c01, identifier: AN32414
2026-03-27 19:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE70578> (referer: https://www.auto1.com/v1/car-details-view/TE70578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: befdcefa-4603-5081-b9fa-9a2e80bc5c01 with identifier: AN32414
2026-03-27 19:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: befdcefa-4603-5081-b9fa-9a2e80bc5c01 with identifier: AN32414
2026-03-27 19:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: befdcefa-4603-5081-b9fa-9a2e80bc5c01 with identifier: AN32414 to the API
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:04:45Z',
 'fuel_type': 'petrol',
 'id': 'befdcefa-4603-5081-b9fa-9a2e80bc5c01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN32414',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 202184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-11',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN32414%27 HTTP/1.1" 200 None
2026-03-27 19:11:14 [auto1.nl] INFO: Saving data for AN32414: {'auction_closing_time': 1774713885.0, 'created_time': 1774440657.785849, 'last_price_update_time': 1774638674.652819}
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AN32414') HTTP/1.1" 204 0
2026-03-27 19:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:14 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-27 19:11:14 [auto1.nl] INFO: Scrape type for VL80205: 1
2026-03-27 19:11:14 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN49901%27 HTTP/1.1" 200 None
2026-03-27 19:11:14 [auto1.nl] INFO: Scrape type for PN49901: 0
2026-03-27 19:11:14 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-27 19:11:14 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA98443%27 HTTP/1.1" 200 None
2026-03-27 19:11:14 [auto1.nl] INFO: Scrape type for WA98443: 2
2026-03-27 19:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d1af50-553f-5688-9412-5cf41b1adec3 with identifier: WA98443
2026-03-27 19:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d1af50-553f-5688-9412-5cf41b1adec3 with scrape type 2
2026-03-27 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87d1af50-553f-5688-9412-5cf41b1adec3 with scrape type 2
2026-03-27 19:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 87d1af50-553f-5688-9412-5cf41b1adec3, identifier: WA98443
2026-03-27 19:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 87d1af50-553f-5688-9412-5cf41b1adec3 with identifier: WA98443
2026-03-27 19:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 87d1af50-553f-5688-9412-5cf41b1adec3 with identifier: WA98443
2026-03-27 19:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 87d1af50-553f-5688-9412-5cf41b1adec3 with identifier: WA98443 to the API
2026-03-27 19:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:41:27Z',
 'fuel_type': 'petrol',
 'id': '87d1af50-553f-5688-9412-5cf41b1adec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA98443',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 276237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-25',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Reference Copa Ecomotive',
 'transmission': 'manual',
 'trim': 'Reference Copa Ecomotive',
 'year': 2012}
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA98443%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Saving data for WA98443: {'auction_closing_time': 1774716087.0, 'created_time': 1774440684.472144, 'last_price_update_time': 1774638675.160933}
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WA98443') HTTP/1.1" 204 0
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Scrape type for RJ32742: 0
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: GJ08711
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ08711%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Scrape type for GJ08711: 1
2026-03-27 19:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b42b81bb-2d73-53d6-b8cb-8ec98d05370e with identifier: TE70578
2026-03-27 19:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b42b81bb-2d73-53d6-b8cb-8ec98d05370e with scrape type 1
2026-03-27 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b42b81bb-2d73-53d6-b8cb-8ec98d05370e
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fcacb0d6a0a112e645caddf50276cbf%252Fpa%252FTE70578_00bc2887ccd517f2b95c20d52fbfa6bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_00bc2887ccd517f2b95c20d52fbfa6bf.jpg already downloaded
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fcacb0d6a0a112e645caddf50276cbf%252Fpa%252FTE70578_48397ccb7c553ec765fd53eab05f29c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_48397ccb7c553ec765fd53eab05f29c7.jpg already downloaded
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fcacb0d6a0a112e645caddf50276cbf%252Fpa%252FTE70578_c7203274db56daa4e34be56261bc25a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_c7203274db56daa4e34be56261bc25a7.jpg already downloaded
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fcacb0d6a0a112e645caddf50276cbf%252Fpa%252FTE70578_a2e45c0555317269f09e8324e356375e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_a2e45c0555317269f09e8324e356375e.jpg already downloaded
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fcacb0d6a0a112e645caddf50276cbf%252Fpa%252FTE70578_00da585a3689222ee721f8efe4f2238e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_00da585a3689222ee721f8efe4f2238e.jpg already downloaded
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fcacb0d6a0a112e645caddf50276cbf%252Fpa%252FTE70578_0affeb41f86b67c2061b99604e7e5ade.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_0affeb41f86b67c2061b99604e7e5ade.jpg already downloaded
2026-03-27 19:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b42b81bb-2d73-53d6-b8cb-8ec98d05370e, identifier: TE70578
2026-03-27 19:11:15 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 916 | hits on page: 40
2026-03-27 19:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b42b81bb-2d73-53d6-b8cb-8ec98d05370e with identifier: TE70578
2026-03-27 19:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b42b81bb-2d73-53d6-b8cb-8ec98d05370e with identifier: TE70578
2026-03-27 19:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b42b81bb-2d73-53d6-b8cb-8ec98d05370e with identifier: TE70578 to the API
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TE70578>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.5L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:56:52Z',
 'fuel_type': 'petrol',
 'id': 'b42b81bb-2d73-53d6-b8cb-8ec98d05370e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '35ZRFB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE70578',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 281103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_00bc2887ccd517f2b95c20d52fbfa6bf.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_48397ccb7c553ec765fd53eab05f29c7.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_c7203274db56daa4e34be56261bc25a7.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_a2e45c0555317269f09e8324e356375e.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_00da585a3689222ee721f8efe4f2238e.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_0affeb41f86b67c2061b99604e7e5ade.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42b81bb-2d73-53d6-b8cb-8ec98d05370e/b42b81bb-2d73-53d6-b8cb-8ec98d05370e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_00bc2887ccd517f2b95c20d52fbfa6bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42b81bb-2d73-53d6-b8cb-8ec98d05370e/b42b81bb-2d73-53d6-b8cb-8ec98d05370e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_48397ccb7c553ec765fd53eab05f29c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42b81bb-2d73-53d6-b8cb-8ec98d05370e/b42b81bb-2d73-53d6-b8cb-8ec98d05370e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_c7203274db56daa4e34be56261bc25a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42b81bb-2d73-53d6-b8cb-8ec98d05370e/b42b81bb-2d73-53d6-b8cb-8ec98d05370e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_a2e45c0555317269f09e8324e356375e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42b81bb-2d73-53d6-b8cb-8ec98d05370e/b42b81bb-2d73-53d6-b8cb-8ec98d05370e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_00da585a3689222ee721f8efe4f2238e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42b81bb-2d73-53d6-b8cb-8ec98d05370e/b42b81bb-2d73-53d6-b8cb-8ec98d05370e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fcacb0d6a0a112e645caddf50276cbf/pa/TE70578_0affeb41f86b67c2061b99604e7e5ade.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC90 2.5 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Saving data for TE70578: {'created_time': 1774638675.682659, 'last_price_update_time': 1774638675.682668, 'auction_closing_time': 1774717012.0}
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TE70578') HTTP/1.1" 204 0
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Scrape type for LC20908: 2
2026-03-27 19:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb69261-0d13-577f-b2e2-08661946640d with identifier: LC20908
2026-03-27 19:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb69261-0d13-577f-b2e2-08661946640d with scrape type 2
2026-03-27 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb69261-0d13-577f-b2e2-08661946640d with scrape type 2
2026-03-27 19:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: acb69261-0d13-577f-b2e2-08661946640d, identifier: LC20908
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV28211%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Scrape type for TV28211: 0
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB61734%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Scrape type for NB61734: 0
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP69884%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Scrape type for RP69884: 0
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Scrape type for VL52985: 0
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: EL39193
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA16838%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Scrape type for BA16838: 0
2026-03-27 19:11:15 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-27 19:11:15 [auto1.nl] INFO: Scrape type for SS31744: 2
2026-03-27 19:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744
2026-03-27 19:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with scrape type 2
2026-03-27 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with scrape type 2
2026-03-27 19:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c92c6ce7-fe04-5511-b5e2-06e6d61ef918, identifier: SS31744
2026-03-27 19:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: acb69261-0d13-577f-b2e2-08661946640d with identifier: LC20908
2026-03-27 19:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: acb69261-0d13-577f-b2e2-08661946640d with identifier: LC20908
2026-03-27 19:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: acb69261-0d13-577f-b2e2-08661946640d with identifier: LC20908 to the API
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-28T16:52:12Z',
 'fuel_type': 'petrol',
 'id': 'acb69261-0d13-577f-b2e2-08661946640d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC20908',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 108762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-27 19:11:16 [auto1.nl] INFO: Saving data for LC20908: {'auction_closing_time': 1774716732.0, 'created_time': 1774552228.739502, 'last_price_update_time': 1774638676.264818}
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LC20908') HTTP/1.1" 204 0
2026-03-27 19:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744
2026-03-27 19:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744
2026-03-27 19:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744 to the API
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:14:16Z',
 'fuel_type': 'petrol',
 'id': 'c92c6ce7-fe04-5511-b5e2-06e6d61ef918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS31744',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 114328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-27 19:11:16 [auto1.nl] INFO: Saving data for SS31744: {'auction_closing_time': 1774714456.0, 'created_time': 1773301901.096264, 'last_price_update_time': 1774638676.671033}
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SS31744') HTTP/1.1" 204 0
2026-03-27 19:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-27 19:11:16 [auto1.nl] INFO: Scrape type for MR73967: 0
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD05711%27 HTTP/1.1" 200 None
2026-03-27 19:11:16 [auto1.nl] INFO: Scrape type for TD05711: 2
2026-03-27 19:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3bcb737-9843-59a7-a7f9-1d94a4a6d897 with identifier: TD05711
2026-03-27 19:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3bcb737-9843-59a7-a7f9-1d94a4a6d897 with scrape type 2
2026-03-27 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3bcb737-9843-59a7-a7f9-1d94a4a6d897 with scrape type 2
2026-03-27 19:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b3bcb737-9843-59a7-a7f9-1d94a4a6d897, identifier: TD05711
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-27 19:11:16 [auto1.nl] INFO: Scrape type for TP84646: 0
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM20026%27 HTTP/1.1" 200 None
2026-03-27 19:11:16 [auto1.nl] INFO: Scrape type for RM20026: 0
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-27 19:11:16 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-27 19:11:16 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX87704%27 HTTP/1.1" 200 None
2026-03-27 19:11:16 [auto1.nl] INFO: Scrape type for MX87704: 2
2026-03-27 19:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26202789-454c-5625-bf26-72a712b69b2a with identifier: MX87704
2026-03-27 19:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26202789-454c-5625-bf26-72a712b69b2a with scrape type 2
2026-03-27 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26202789-454c-5625-bf26-72a712b69b2a with scrape type 2
2026-03-27 19:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 26202789-454c-5625-bf26-72a712b69b2a, identifier: MX87704
2026-03-27 19:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b3bcb737-9843-59a7-a7f9-1d94a4a6d897 with identifier: TD05711
2026-03-27 19:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b3bcb737-9843-59a7-a7f9-1d94a4a6d897 with identifier: TD05711
2026-03-27 19:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b3bcb737-9843-59a7-a7f9-1d94a4a6d897 with identifier: TD05711 to the API
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:14:38Z',
 'fuel_type': 'hybrid',
 'id': 'b3bcb737-9843-59a7-a7f9-1d94a4a6d897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD05711',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 123986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD05711%27 HTTP/1.1" 200 None
2026-03-27 19:11:17 [auto1.nl] INFO: Saving data for TD05711: {'auction_closing_time': 1774714478.0, 'created_time': 1774440651.916431, 'last_price_update_time': 1774638677.274016}
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TD05711') HTTP/1.1" 204 0
2026-03-27 19:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 26202789-454c-5625-bf26-72a712b69b2a with identifier: MX87704
2026-03-27 19:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 26202789-454c-5625-bf26-72a712b69b2a with identifier: MX87704
2026-03-27 19:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 26202789-454c-5625-bf26-72a712b69b2a with identifier: MX87704 to the API
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:59:24Z',
 'fuel_type': 'petrol',
 'id': '26202789-454c-5625-bf26-72a712b69b2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX87704',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 101954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-14',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 CATCH ME Now',
 'transmission': 'manual',
 'trim': 'CATCH ME Now',
 'year': 2008}
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX87704%27 HTTP/1.1" 200 None
2026-03-27 19:11:17 [auto1.nl] INFO: Saving data for MX87704: {'auction_closing_time': 1774717164.0, 'created_time': 1773688658.441525, 'last_price_update_time': 1774638677.582451}
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MX87704') HTTP/1.1" 204 0
2026-03-27 19:11:17 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-27 19:11:17 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-27 19:11:17 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-27 19:11:17 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH98197%27 HTTP/1.1" 200 None
2026-03-27 19:11:17 [auto1.nl] INFO: Scrape type for EH98197: 0
2026-03-27 19:11:17 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-27 19:11:17 [auto1.nl] INFO: Scrape type for EG83115: 0
2026-03-27 19:11:17 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-27 19:11:17 [auto1.nl] INFO: Scrape type for JZ35389: 1
2026-03-27 19:11:17 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG56616%27 HTTP/1.1" 200 None
2026-03-27 19:11:17 [auto1.nl] INFO: Scrape type for HG56616: 2
2026-03-27 19:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9968adb5-3aec-55b4-b841-d22ba1171ecf with identifier: HG56616
2026-03-27 19:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9968adb5-3aec-55b4-b841-d22ba1171ecf with scrape type 2
2026-03-27 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9968adb5-3aec-55b4-b841-d22ba1171ecf with scrape type 2
2026-03-27 19:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9968adb5-3aec-55b4-b841-d22ba1171ecf, identifier: HG56616
2026-03-27 19:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9968adb5-3aec-55b4-b841-d22ba1171ecf with identifier: HG56616
2026-03-27 19:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9968adb5-3aec-55b4-b841-d22ba1171ecf with identifier: HG56616
2026-03-27 19:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9968adb5-3aec-55b4-b841-d22ba1171ecf with identifier: HG56616 to the API
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:18:34Z',
 'fuel_type': 'petrol',
 'id': '9968adb5-3aec-55b4-b841-d22ba1171ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG56616',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 280618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-07',
 'seller_name': None,
 'title': 'Volvo V70 2.0 T Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2010}
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG56616%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Saving data for HG56616: {'auction_closing_time': 1774714714.0, 'created_time': 1773515455.99366, 'last_price_update_time': 1774638678.016682}
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HG56616') HTTP/1.1" 204 0
2026-03-27 19:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for SG32295: 0
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR89214%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for MR89214: 2
2026-03-27 19:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a570ecbc-a625-5a1b-bbc9-4d00add3999b with identifier: MR89214
2026-03-27 19:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a570ecbc-a625-5a1b-bbc9-4d00add3999b with scrape type 2
2026-03-27 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a570ecbc-a625-5a1b-bbc9-4d00add3999b with scrape type 2
2026-03-27 19:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a570ecbc-a625-5a1b-bbc9-4d00add3999b, identifier: MR89214
2026-03-27 19:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a570ecbc-a625-5a1b-bbc9-4d00add3999b with identifier: MR89214
2026-03-27 19:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a570ecbc-a625-5a1b-bbc9-4d00add3999b with identifier: MR89214
2026-03-27 19:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a570ecbc-a625-5a1b-bbc9-4d00add3999b with identifier: MR89214 to the API
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:50:11Z',
 'fuel_type': 'diesel',
 'id': 'a570ecbc-a625-5a1b-bbc9-4d00add3999b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR89214',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 172629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-25',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Kasten BlueMotion',
 'year': 2017}
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR89214%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Saving data for MR89214: {'auction_closing_time': 1774716611.0, 'created_time': 1774440707.607388, 'last_price_update_time': 1774638678.477901}
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MR89214') HTTP/1.1" 204 0
2026-03-27 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD99184> (referer: https://www.auto1.com/v1/car-details-view/GD99184/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for TJ11018: 0
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: HL48318
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL48318%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for HL48318: 1
2026-03-27 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL80205/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: VN36525
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC82380%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for RC82380: 0
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for JZ14599: 0
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for AX28541: 1
2026-03-27 19:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK31365%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for KK31365: 0
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for ZR40703: 0
2026-03-27 19:11:18 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22652%27 HTTP/1.1" 200 None
2026-03-27 19:11:18 [auto1.nl] INFO: Scrape type for SV22652: 2
2026-03-27 19:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a031ab2c-6f01-5b0b-a514-16f8e4a8182c with identifier: SV22652
2026-03-27 19:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a031ab2c-6f01-5b0b-a514-16f8e4a8182c with scrape type 2
2026-03-27 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a031ab2c-6f01-5b0b-a514-16f8e4a8182c with scrape type 2
2026-03-27 19:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a031ab2c-6f01-5b0b-a514-16f8e4a8182c, identifier: SV22652
2026-03-27 19:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a031ab2c-6f01-5b0b-a514-16f8e4a8182c with identifier: SV22652
2026-03-27 19:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a031ab2c-6f01-5b0b-a514-16f8e4a8182c with identifier: SV22652
2026-03-27 19:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a031ab2c-6f01-5b0b-a514-16f8e4a8182c with identifier: SV22652 to the API
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:33:15Z',
 'fuel_type': 'diesel',
 'id': 'a031ab2c-6f01-5b0b-a514-16f8e4a8182c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV22652',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 214427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-05',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22652%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [auto1.nl] INFO: Saving data for SV22652: {'auction_closing_time': 1774715595.0, 'created_time': 1774379565.799636, 'last_price_update_time': 1774638679.003128}
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV22652') HTTP/1.1" 204 0
2026-03-27 19:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:19 [auto1.nl] INFO: Found listing with ID: NM97362
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM97362%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [auto1.nl] INFO: Scrape type for NM97362: 2
2026-03-27 19:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4be3614-83c7-5da3-b314-2792483fa860 with identifier: NM97362
2026-03-27 19:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4be3614-83c7-5da3-b314-2792483fa860 with scrape type 2
2026-03-27 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4be3614-83c7-5da3-b314-2792483fa860 with scrape type 2
2026-03-27 19:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e4be3614-83c7-5da3-b314-2792483fa860, identifier: NM97362
2026-03-27 19:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e4be3614-83c7-5da3-b314-2792483fa860 with identifier: NM97362
2026-03-27 19:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e4be3614-83c7-5da3-b314-2792483fa860 with identifier: NM97362
2026-03-27 19:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e4be3614-83c7-5da3-b314-2792483fa860 with identifier: NM97362 to the API
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:01:26Z',
 'fuel_type': 'petrol',
 'id': 'e4be3614-83c7-5da3-b314-2792483fa860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM97362',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 149487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-29',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM97362%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [auto1.nl] INFO: Saving data for NM97362: {'auction_closing_time': 1774713686.0, 'created_time': 1773229311.647615, 'last_price_update_time': 1774638679.473566}
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NM97362') HTTP/1.1" 204 0
2026-03-27 19:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 882b646f-7bf7-5945-bd5a-537463b8139c with identifier: GD99184
2026-03-27 19:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882b646f-7bf7-5945-bd5a-537463b8139c with scrape type 1
2026-03-27 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_5ecbe653f816140f0b7c30d499887f2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5ecbe653f816140f0b7c30d499887f2c.jpg not downloaded yet
2026-03-27 19:11:19 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [auto1.nl] INFO: Scrape type for LE78061: 0
2026-03-27 19:11:19 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [auto1.nl] INFO: Scrape type for MD18353: 2
2026-03-27 19:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with identifier: MD18353
2026-03-27 19:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with scrape type 2
2026-03-27 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with scrape type 2
2026-03-27 19:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 505ee203-78d9-5301-bcdb-ba3c49c27bb0, identifier: MD18353
2026-03-27 19:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with identifier: MD18353
2026-03-27 19:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with identifier: MD18353
2026-03-27 19:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with identifier: MD18353 to the API
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-28T16:44:51Z',
 'fuel_type': 'petrol',
 'id': '505ee203-78d9-5301-bcdb-ba3c49c27bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD18353',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 67606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [auto1.nl] INFO: Saving data for MD18353: {'auction_closing_time': 1774716291.0, 'created_time': 1774354364.734831, 'last_price_update_time': 1774638679.883441}
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD18353') HTTP/1.1" 204 0
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_278a54526845b6a5e8453362073401c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_278a54526845b6a5e8453362073401c2.jpg not downloaded yet
2026-03-27 19:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:19 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-27 19:11:19 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [auto1.nl] INFO: Scrape type for JL68792: 0
2026-03-27 19:11:19 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UK83589%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [auto1.nl] INFO: Scrape type for UK83589: 0
2026-03-27 19:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ08711/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_a0c8c3ee7d48305b984e8d88255eface.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_a0c8c3ee7d48305b984e8d88255eface.jpg not downloaded yet
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_1fa626ba5875fc7750d64488b8925519.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_1fa626ba5875fc7750d64488b8925519.jpg not downloaded yet
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_0bf9a0057c2b5220299af2a2f0289703.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_0bf9a0057c2b5220299af2a2f0289703.jpg not downloaded yet
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_609afd926f9c8a3b33b25bcb6ef2b104.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_609afd926f9c8a3b33b25bcb6ef2b104.jpg not downloaded yet
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_5a8d0f5d1cb993dbbeac97798a80849c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5a8d0f5d1cb993dbbeac97798a80849c.jpg not downloaded yet
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_01b7a81974a21de0f74e39efcb7a5a7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_01b7a81974a21de0f74e39efcb7a5a7d.jpg not downloaded yet
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_5f0440ceeec1c646ded901c63ce99904.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5f0440ceeec1c646ded901c63ce99904.jpg not downloaded yet
2026-03-27 19:11:20 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 916 | hits on page: 40
2026-03-27 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_278a54526845b6a5e8453362073401c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_b8f7e2a4b1b3dd98ab81d0c3b15fc46f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_b8f7e2a4b1b3dd98ab81d0c3b15fc46f.jpg not downloaded yet
2026-03-27 19:11:20 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM82020%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [auto1.nl] INFO: Scrape type for JM82020: 2
2026-03-27 19:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff997ccf-d173-566b-967c-f6799b60ed15 with identifier: JM82020
2026-03-27 19:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff997ccf-d173-566b-967c-f6799b60ed15 with scrape type 2
2026-03-27 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff997ccf-d173-566b-967c-f6799b60ed15 with scrape type 2
2026-03-27 19:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ff997ccf-d173-566b-967c-f6799b60ed15, identifier: JM82020
2026-03-27 19:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ff997ccf-d173-566b-967c-f6799b60ed15 with identifier: JM82020
2026-03-27 19:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ff997ccf-d173-566b-967c-f6799b60ed15 with identifier: JM82020
2026-03-27 19:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ff997ccf-d173-566b-967c-f6799b60ed15 with identifier: JM82020 to the API
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:08:01Z',
 'fuel_type': 'diesel',
 'id': 'ff997ccf-d173-566b-967c-f6799b60ed15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM82020',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 329790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2013}
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM82020%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [auto1.nl] INFO: Saving data for JM82020: {'auction_closing_time': 1774714081.0, 'created_time': 1774440626.533157, 'last_price_update_time': 1774638680.546915}
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM82020') HTTP/1.1" 204 0
2026-03-27 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_a0c8c3ee7d48305b984e8d88255eface.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:20 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-27 19:11:20 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-27 19:11:20 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-27 19:11:20 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17699%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [auto1.nl] INFO: Scrape type for RT17699: 2
2026-03-27 19:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b52f8f3-dec9-5d0c-b0ab-f1e8dcc61f8b with identifier: RT17699
2026-03-27 19:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b52f8f3-dec9-5d0c-b0ab-f1e8dcc61f8b with scrape type 2
2026-03-27 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b52f8f3-dec9-5d0c-b0ab-f1e8dcc61f8b with scrape type 2
2026-03-27 19:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9b52f8f3-dec9-5d0c-b0ab-f1e8dcc61f8b, identifier: RT17699
2026-03-27 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_609afd926f9c8a3b33b25bcb6ef2b104.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5a8d0f5d1cb993dbbeac97798a80849c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_1fa626ba5875fc7750d64488b8925519.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9b52f8f3-dec9-5d0c-b0ab-f1e8dcc61f8b with identifier: RT17699
2026-03-27 19:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9b52f8f3-dec9-5d0c-b0ab-f1e8dcc61f8b with identifier: RT17699
2026-03-27 19:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9b52f8f3-dec9-5d0c-b0ab-f1e8dcc61f8b with identifier: RT17699 to the API
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:54:30Z',
 'fuel_type': 'diesel',
 'id': '9b52f8f3-dec9-5d0c-b0ab-f1e8dcc61f8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT17699',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 159565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-26',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2018}
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17699%27 HTTP/1.1" 200 None
2026-03-27 19:11:20 [auto1.nl] INFO: Saving data for RT17699: {'auction_closing_time': 1774716870.0, 'created_time': 1774465827.338573, 'last_price_update_time': 1774638680.928246}
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT17699') HTTP/1.1" 204 0
2026-03-27 19:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5f0440ceeec1c646ded901c63ce99904.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_01b7a81974a21de0f74e39efcb7a5a7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:21 [auto1.nl] INFO: Found listing with ID: ZP63957
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63957%27 HTTP/1.1" 200 None
2026-03-27 19:11:21 [auto1.nl] INFO: Scrape type for ZP63957: 2
2026-03-27 19:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7add885-04fa-539e-8356-e7d87044e725 with identifier: ZP63957
2026-03-27 19:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7add885-04fa-539e-8356-e7d87044e725 with scrape type 2
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7add885-04fa-539e-8356-e7d87044e725 with scrape type 2
2026-03-27 19:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7add885-04fa-539e-8356-e7d87044e725, identifier: ZP63957
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae357a1d0>
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_278a54526845b6a5e8453362073401c2.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_278a54526845b6a5e8453362073401c2.jpg saved to cache
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7add885-04fa-539e-8356-e7d87044e725 with identifier: ZP63957
2026-03-27 19:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7add885-04fa-539e-8356-e7d87044e725 with identifier: ZP63957
2026-03-27 19:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7add885-04fa-539e-8356-e7d87044e725 with identifier: ZP63957 to the API
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:47:17Z',
 'fuel_type': 'petrol',
 'id': 'e7add885-04fa-539e-8356-e7d87044e725',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP63957',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 91993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-26',
 'seller_name': None,
 'title': 'Nissan Juke 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63957%27 HTTP/1.1" 200 None
2026-03-27 19:11:21 [auto1.nl] INFO: Saving data for ZP63957: {'auction_closing_time': 1774716437.0, 'created_time': 1773132433.646095, 'last_price_update_time': 1774638681.45999}
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP63957') HTTP/1.1" 204 0
2026-03-27 19:11:21 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-27 19:11:21 [auto1.nl] INFO: Scrape type for ZX00670: 0
2026-03-27 19:11:21 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-27 19:11:21 [auto1.nl] INFO: Scrape type for NT73578: 2
2026-03-27 19:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578
2026-03-27 19:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with scrape type 2
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with scrape type 2
2026-03-27 19:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 055966f4-c3ce-500a-bade-b5abdc9cd5d3, identifier: NT73578
2026-03-27 19:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ35389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL48318/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33b5bd0>
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_a0c8c3ee7d48305b984e8d88255eface.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_a0c8c3ee7d48305b984e8d88255eface.jpg saved to cache
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae93b9810>
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_609afd926f9c8a3b33b25bcb6ef2b104.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_609afd926f9c8a3b33b25bcb6ef2b104.jpg saved to cache
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3583210>
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_5a8d0f5d1cb993dbbeac97798a80849c.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5a8d0f5d1cb993dbbeac97798a80849c.jpg saved to cache
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34e8ad0>
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_1fa626ba5875fc7750d64488b8925519.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_1fa626ba5875fc7750d64488b8925519.jpg saved to cache
2026-03-27 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_b8f7e2a4b1b3dd98ab81d0c3b15fc46f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578
2026-03-27 19:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578
2026-03-27 19:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578 to the API
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:53Z',
 'fuel_type': 'diesel',
 'id': '055966f4-c3ce-500a-bade-b5abdc9cd5d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT73578',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-06',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-27 19:11:22 [auto1.nl] INFO: Saving data for NT73578: {'auction_closing_time': 1774715933.0, 'created_time': 1773923868.168898, 'last_price_update_time': 1774638682.018662}
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NT73578') HTTP/1.1" 204 0
2026-03-27 19:11:22 [auto1.nl] INFO: Found listing with ID: NS77626
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS77626%27 HTTP/1.1" 200 None
2026-03-27 19:11:22 [auto1.nl] INFO: Scrape type for NS77626: 2
2026-03-27 19:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aba1f179-7596-5e59-a47c-c08079f279e4 with identifier: NS77626
2026-03-27 19:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aba1f179-7596-5e59-a47c-c08079f279e4 with scrape type 2
2026-03-27 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aba1f179-7596-5e59-a47c-c08079f279e4 with scrape type 2
2026-03-27 19:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aba1f179-7596-5e59-a47c-c08079f279e4, identifier: NS77626
2026-03-27 19:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX28541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL80205> (referer: https://www.auto1.com/v1/car-details-view/VL80205/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae8295910>
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_5f0440ceeec1c646ded901c63ce99904.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5f0440ceeec1c646ded901c63ce99904.jpg saved to cache
2026-03-27 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae333fdd0>
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_01b7a81974a21de0f74e39efcb7a5a7d.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_01b7a81974a21de0f74e39efcb7a5a7d.jpg saved to cache
2026-03-27 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aba1f179-7596-5e59-a47c-c08079f279e4 with identifier: NS77626
2026-03-27 19:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aba1f179-7596-5e59-a47c-c08079f279e4 with identifier: NS77626
2026-03-27 19:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aba1f179-7596-5e59-a47c-c08079f279e4 with identifier: NS77626 to the API
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:58:39Z',
 'fuel_type': 'petrol',
 'id': 'aba1f179-7596-5e59-a47c-c08079f279e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS77626',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 142951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-24',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2015}
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS77626%27 HTTP/1.1" 200 None
2026-03-27 19:11:22 [auto1.nl] INFO: Saving data for NS77626: {'auction_closing_time': 1774717119.0, 'created_time': 1773301476.978823, 'last_price_update_time': 1774638682.54928}
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NS77626') HTTP/1.1" 204 0
2026-03-27 19:11:22 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA68002%27 HTTP/1.1" 200 None
2026-03-27 19:11:22 [auto1.nl] INFO: Scrape type for DA68002: 0
2026-03-27 19:11:22 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-27 19:11:22 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-27 19:11:22 [auto1.nl] INFO: Found listing with ID: FH97185
2026-03-27 19:11:22 [auto1.nl] INFO: Found listing with ID: LX15335
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX15335%27 HTTP/1.1" 200 None
2026-03-27 19:11:22 [auto1.nl] INFO: Scrape type for LX15335: 2
2026-03-27 19:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2834ce-6ca9-5372-8d75-678814c1d06c with identifier: LX15335
2026-03-27 19:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2834ce-6ca9-5372-8d75-678814c1d06c with scrape type 2
2026-03-27 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2834ce-6ca9-5372-8d75-678814c1d06c with scrape type 2
2026-03-27 19:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6f2834ce-6ca9-5372-8d75-678814c1d06c, identifier: LX15335
2026-03-27 19:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6f2834ce-6ca9-5372-8d75-678814c1d06c with identifier: LX15335
2026-03-27 19:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6f2834ce-6ca9-5372-8d75-678814c1d06c with identifier: LX15335
2026-03-27 19:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6f2834ce-6ca9-5372-8d75-678814c1d06c with identifier: LX15335 to the API
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:33:19Z',
 'fuel_type': 'petrol',
 'id': '6f2834ce-6ca9-5372-8d75-678814c1d06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX15335',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 75372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-07',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Vision 4WD',
 'transmission': 'automatic',
 'trim': 'Vision 4WD',
 'year': 2017}
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX15335%27 HTTP/1.1" 200 None
2026-03-27 19:11:22 [auto1.nl] INFO: Saving data for LX15335: {'auction_closing_time': 1774715599.0, 'created_time': 1773232394.591069, 'last_price_update_time': 1774638682.966562}
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LX15335') HTTP/1.1" 204 0
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3431a50>
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_b8f7e2a4b1b3dd98ab81d0c3b15fc46f.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_b8f7e2a4b1b3dd98ab81d0c3b15fc46f.jpg saved to cache
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:23 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF13201%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [auto1.nl] INFO: Scrape type for KF13201: 0
2026-03-27 19:11:23 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [auto1.nl] INFO: Scrape type for FJ04475: 2
2026-03-27 19:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475
2026-03-27 19:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b249a31f-66af-5e6c-9918-fdb2ad096d7e with scrape type 2
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b249a31f-66af-5e6c-9918-fdb2ad096d7e with scrape type 2
2026-03-27 19:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b249a31f-66af-5e6c-9918-fdb2ad096d7e, identifier: FJ04475
2026-03-27 19:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475
2026-03-27 19:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475
2026-03-27 19:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475 to the API
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:20:06Z',
 'fuel_type': 'petrol',
 'id': 'b249a31f-66af-5e6c-9918-fdb2ad096d7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ04475',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 264799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2012}
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [auto1.nl] INFO: Saving data for FJ04475: {'auction_closing_time': 1774714806.0, 'created_time': 1773664237.04298, 'last_price_update_time': 1774638683.433471}
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ04475') HTTP/1.1" 204 0
2026-03-27 19:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205
2026-03-27 19:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9520c497-6ea0-5467-8437-118e03e39bc8 with scrape type 1
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9520c497-6ea0-5467-8437-118e03e39bc8
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c38b399a36945b9bce276016f6552b%252Fpa%252FVL80205_2bb7aebc7fc5d2904a2bde2aaa134802.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_2bb7aebc7fc5d2904a2bde2aaa134802.jpg already downloaded
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c38b399a36945b9bce276016f6552b%252Fpa%252FVL80205_79bbbb3ec87a3719e7274e2f32c233b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_79bbbb3ec87a3719e7274e2f32c233b9.jpg already downloaded
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c38b399a36945b9bce276016f6552b%252Fpa%252FVL80205_efc3cc8fd9f2b84eb17514b33ffc5604.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_efc3cc8fd9f2b84eb17514b33ffc5604.jpg already downloaded
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c38b399a36945b9bce276016f6552b%252Fpa%252FVL80205_c81c2f184c0eb74a02f437f81a9cc097.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_c81c2f184c0eb74a02f437f81a9cc097.jpg already downloaded
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c38b399a36945b9bce276016f6552b%252Fpa%252FVL80205_a3ee489eb0b4233e35b527dc98531b5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_a3ee489eb0b4233e35b527dc98531b5a.jpg already downloaded
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c38b399a36945b9bce276016f6552b%252Fpa%252FVL80205_5216e27f030747918027da56cae56471.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_5216e27f030747918027da56cae56471.jpg already downloaded
2026-03-27 19:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9520c497-6ea0-5467-8437-118e03e39bc8, identifier: VL80205
2026-03-27 19:11:23 [auto1.nl] INFO: Found listing with ID: GG50012
2026-03-27 19:11:23 [auto1.nl] INFO: Found listing with ID: NM87332
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM87332%27 HTTP/1.1" 200 None
2026-03-27 19:11:23 [auto1.nl] INFO: Scrape type for NM87332: 1
2026-03-27 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205
2026-03-27 19:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205
2026-03-27 19:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205 to the API
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VL80205>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 2',
 'engine': '2.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:05Z',
 'fuel_type': 'petrol',
 'id': '9520c497-6ea0-5467-8437-118e03e39bc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '42FHHX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL80205',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mitsubishi',
 'model': 'Space',
 'odometer': 208362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_2bb7aebc7fc5d2904a2bde2aaa134802.jpg',
                'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_79bbbb3ec87a3719e7274e2f32c233b9.jpg',
                'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_efc3cc8fd9f2b84eb17514b33ffc5604.jpg',
                'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_c81c2f184c0eb74a02f437f81a9cc097.jpg',
                'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_a3ee489eb0b4233e35b527dc98531b5a.jpg',
                'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_5216e27f030747918027da56cae56471.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9520c497-6ea0-5467-8437-118e03e39bc8/9520c497-6ea0-5467-8437-118e03e39bc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_2bb7aebc7fc5d2904a2bde2aaa134802.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9520c497-6ea0-5467-8437-118e03e39bc8/9520c497-6ea0-5467-8437-118e03e39bc8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_79bbbb3ec87a3719e7274e2f32c233b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9520c497-6ea0-5467-8437-118e03e39bc8/9520c497-6ea0-5467-8437-118e03e39bc8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_efc3cc8fd9f2b84eb17514b33ffc5604.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9520c497-6ea0-5467-8437-118e03e39bc8/9520c497-6ea0-5467-8437-118e03e39bc8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_c81c2f184c0eb74a02f437f81a9cc097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9520c497-6ea0-5467-8437-118e03e39bc8/9520c497-6ea0-5467-8437-118e03e39bc8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_a3ee489eb0b4233e35b527dc98531b5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9520c497-6ea0-5467-8437-118e03e39bc8/9520c497-6ea0-5467-8437-118e03e39bc8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c38b399a36945b9bce276016f6552b/pa/VL80205_5216e27f030747918027da56cae56471.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-03-31',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Mitsubishi Space 2.4 GDI Motion',
 'transmission': 'manual',
 'trim': 'Motion',
 'year': 2000}
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-27 19:11:24 [auto1.nl] INFO: Saving data for VL80205: {'created_time': 1774638684.051377, 'last_price_update_time': 1774638684.051386, 'auction_closing_time': 1774714505.0}
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL80205') HTTP/1.1" 204 0
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: MN54197
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN54197%27 HTTP/1.1" 200 None
2026-03-27 19:11:24 [auto1.nl] INFO: Scrape type for MN54197: 2
2026-03-27 19:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ed8217-a267-5776-a241-ebb94f25d36f with identifier: MN54197
2026-03-27 19:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ed8217-a267-5776-a241-ebb94f25d36f with scrape type 2
2026-03-27 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26ed8217-a267-5776-a241-ebb94f25d36f with scrape type 2
2026-03-27 19:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 26ed8217-a267-5776-a241-ebb94f25d36f, identifier: MN54197
2026-03-27 19:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 26ed8217-a267-5776-a241-ebb94f25d36f with identifier: MN54197
2026-03-27 19:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 26ed8217-a267-5776-a241-ebb94f25d36f with identifier: MN54197
2026-03-27 19:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 26ed8217-a267-5776-a241-ebb94f25d36f with identifier: MN54197 to the API
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:35:59Z',
 'fuel_type': 'petrol',
 'id': '26ed8217-a267-5776-a241-ebb94f25d36f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN54197',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 117710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-25',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2014}
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN54197%27 HTTP/1.1" 200 None
2026-03-27 19:11:24 [auto1.nl] INFO: Saving data for MN54197: {'auction_closing_time': 1774715759.0, 'created_time': 1773774814.935127, 'last_price_update_time': 1774638684.455253}
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MN54197') HTTP/1.1" 204 0
2026-03-27 19:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ08711> (referer: https://www.auto1.com/v1/car-details-view/GJ08711/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW77077%27 HTTP/1.1" 200 None
2026-03-27 19:11:24 [auto1.nl] INFO: Scrape type for VW77077: 2
2026-03-27 19:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0824cc72-7f30-56a8-89f5-70b2d750533d with identifier: VW77077
2026-03-27 19:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0824cc72-7f30-56a8-89f5-70b2d750533d with scrape type 2
2026-03-27 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0824cc72-7f30-56a8-89f5-70b2d750533d with scrape type 2
2026-03-27 19:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0824cc72-7f30-56a8-89f5-70b2d750533d, identifier: VW77077
2026-03-27 19:11:24 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 916 | hits on page: 40
2026-03-27 19:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0824cc72-7f30-56a8-89f5-70b2d750533d with identifier: VW77077
2026-03-27 19:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0824cc72-7f30-56a8-89f5-70b2d750533d with identifier: VW77077
2026-03-27 19:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0824cc72-7f30-56a8-89f5-70b2d750533d with identifier: VW77077 to the API
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:54:15Z',
 'fuel_type': 'petrol',
 'id': '0824cc72-7f30-56a8-89f5-70b2d750533d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW77077',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 225264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-17',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW77077%27 HTTP/1.1" 200 None
2026-03-27 19:11:24 [auto1.nl] INFO: Saving data for VW77077: {'auction_closing_time': 1774716855.0, 'created_time': 1774440712.541141, 'last_price_update_time': 1774638684.826516}
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VW77077') HTTP/1.1" 204 0
2026-03-27 19:11:24 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN17461%27 HTTP/1.1" 200 None
2026-03-27 19:11:24 [auto1.nl] INFO: Scrape type for JN17461: 2
2026-03-27 19:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f3e316b-4f90-5d8d-bc0b-8566f9253705 with identifier: JN17461
2026-03-27 19:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f3e316b-4f90-5d8d-bc0b-8566f9253705 with scrape type 2
2026-03-27 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f3e316b-4f90-5d8d-bc0b-8566f9253705 with scrape type 2
2026-03-27 19:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6f3e316b-4f90-5d8d-bc0b-8566f9253705, identifier: JN17461
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: WB40041
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-27 19:11:25 [auto1.nl] INFO: Scrape type for FJ96412: 1
2026-03-27 19:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6f3e316b-4f90-5d8d-bc0b-8566f9253705 with identifier: JN17461
2026-03-27 19:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6f3e316b-4f90-5d8d-bc0b-8566f9253705 with identifier: JN17461
2026-03-27 19:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6f3e316b-4f90-5d8d-bc0b-8566f9253705 with identifier: JN17461 to the API
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:26:40Z',
 'fuel_type': 'diesel',
 'id': '6f3e316b-4f90-5d8d-bc0b-8566f9253705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN17461',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 334219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-16',
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2015}
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN17461%27 HTTP/1.1" 200 None
2026-03-27 19:11:25 [auto1.nl] INFO: Saving data for JN17461: {'auction_closing_time': 1774715200.0, 'created_time': 1774440675.63796, 'last_price_update_time': 1774638685.465167}
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JN17461') HTTP/1.1" 204 0
2026-03-27 19:11:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: HC37182
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-27 19:11:25 [auto1.nl] INFO: Scrape type for NS14796: 0
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: CT04767
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP47777%27 HTTP/1.1" 200 None
2026-03-27 19:11:25 [auto1.nl] INFO: Scrape type for BP47777: 0
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER73656%27 HTTP/1.1" 200 None
2026-03-27 19:11:25 [auto1.nl] INFO: Scrape type for ER73656: 0
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: GM90003
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: LZ58703
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: VH11794
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: BM39529
2026-03-27 19:11:25 [auto1.nl] INFO: Found listing with ID: HT16720
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16720%27 HTTP/1.1" 200 None
2026-03-27 19:11:25 [auto1.nl] INFO: Scrape type for HT16720: 2
2026-03-27 19:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ec6ae26-5868-5fc6-bc80-72bd2d2b523a with identifier: HT16720
2026-03-27 19:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ec6ae26-5868-5fc6-bc80-72bd2d2b523a with scrape type 2
2026-03-27 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ec6ae26-5868-5fc6-bc80-72bd2d2b523a with scrape type 2
2026-03-27 19:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ec6ae26-5868-5fc6-bc80-72bd2d2b523a, identifier: HT16720
2026-03-27 19:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ec6ae26-5868-5fc6-bc80-72bd2d2b523a with identifier: HT16720
2026-03-27 19:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ec6ae26-5868-5fc6-bc80-72bd2d2b523a with identifier: HT16720
2026-03-27 19:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ec6ae26-5868-5fc6-bc80-72bd2d2b523a with identifier: HT16720 to the API
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:34:43Z',
 'fuel_type': 'petrol',
 'id': '7ec6ae26-5868-5fc6-bc80-72bd2d2b523a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT16720',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 51374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-06',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Color',
 'transmission': 'manual',
 'trim': 'Color',
 'year': 2016}
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16720%27 HTTP/1.1" 200 None
2026-03-27 19:11:25 [auto1.nl] INFO: Saving data for HT16720: {'auction_closing_time': 1774715683.0, 'created_time': 1773231594.724363, 'last_price_update_time': 1774638685.888895}
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT16720') HTTP/1.1" 204 0
2026-03-27 19:11:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a871a83-35a9-5e5d-b68b-e4851dd91c8a with identifier: GJ08711
2026-03-27 19:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a871a83-35a9-5e5d-b68b-e4851dd91c8a with scrape type 1
2026-03-27 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a871a83-35a9-5e5d-b68b-e4851dd91c8a
2026-03-27 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_efe507d435718d94a22f8f1e853d7241.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_efe507d435718d94a22f8f1e853d7241.jpg already downloaded
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_0cdd73330008b23ff21657a18a5d7985.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_0cdd73330008b23ff21657a18a5d7985.jpg already downloaded
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_d09b8570c7e29be5be2ea72ea570b13a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_d09b8570c7e29be5be2ea72ea570b13a.jpg already downloaded
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_fad5db120e3e1591c42eabf05b4a8cdc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_fad5db120e3e1591c42eabf05b4a8cdc.jpg already downloaded
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_345fdbd9c8279020335044224fe4ee6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_345fdbd9c8279020335044224fe4ee6b.jpg already downloaded
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_787ff199962f56c4394ad8c634c89283.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_787ff199962f56c4394ad8c634c89283.jpg already downloaded
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_991a39a1217844199c7cc774a2b85754.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_991a39a1217844199c7cc774a2b85754.jpg already downloaded
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_be847bde4da3df227cf5620508edccc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_be847bde4da3df227cf5620508edccc9.jpg already downloaded
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_feeeffcf6caa62aecdf7369122492165.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_feeeffcf6caa62aecdf7369122492165.jpg already downloaded
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff1%252F9ef113fce575cb3d2ba16ecbf1b34757%252Fpa%252FGJ08711_d6a36140433b9e0e4eedd2989e37fbda.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_d6a36140433b9e0e4eedd2989e37fbda.jpg already downloaded
2026-03-27 19:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5a871a83-35a9-5e5d-b68b-e4851dd91c8a, identifier: GJ08711
2026-03-27 19:11:26 [auto1.nl] INFO: Found listing with ID: XC91044
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC91044%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [auto1.nl] INFO: Scrape type for XC91044: 2
2026-03-27 19:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13c5a2a9-069e-55fd-82a7-168c511833a3 with identifier: XC91044
2026-03-27 19:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c5a2a9-069e-55fd-82a7-168c511833a3 with scrape type 2
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13c5a2a9-069e-55fd-82a7-168c511833a3 with scrape type 2
2026-03-27 19:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 13c5a2a9-069e-55fd-82a7-168c511833a3, identifier: XC91044
2026-03-27 19:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5a871a83-35a9-5e5d-b68b-e4851dd91c8a with identifier: GJ08711
2026-03-27 19:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5a871a83-35a9-5e5d-b68b-e4851dd91c8a with identifier: GJ08711
2026-03-27 19:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5a871a83-35a9-5e5d-b68b-e4851dd91c8a with identifier: GJ08711 to the API
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GJ08711>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:30:14Z',
 'fuel_type': 'petrol',
 'id': '5a871a83-35a9-5e5d-b68b-e4851dd91c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RX817G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ08711',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '1er',
 'odometer': 126728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_efe507d435718d94a22f8f1e853d7241.jpg',
                'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_0cdd73330008b23ff21657a18a5d7985.jpg',
                'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_d09b8570c7e29be5be2ea72ea570b13a.jpg',
                'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_fad5db120e3e1591c42eabf05b4a8cdc.jpg',
                'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_345fdbd9c8279020335044224fe4ee6b.jpg',
                'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_787ff199962f56c4394ad8c634c89283.jpg',
                'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_991a39a1217844199c7cc774a2b85754.jpg',
                'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_be847bde4da3df227cf5620508edccc9.jpg',
                'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_feeeffcf6caa62aecdf7369122492165.jpg',
                'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_d6a36140433b9e0e4eedd2989e37fbda.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_efe507d435718d94a22f8f1e853d7241.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_0cdd73330008b23ff21657a18a5d7985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_d09b8570c7e29be5be2ea72ea570b13a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_fad5db120e3e1591c42eabf05b4a8cdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_345fdbd9c8279020335044224fe4ee6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_787ff199962f56c4394ad8c634c89283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_991a39a1217844199c7cc774a2b85754.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_be847bde4da3df227cf5620508edccc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_feeeffcf6caa62aecdf7369122492165.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a871a83-35a9-5e5d-b68b-e4851dd91c8a/5a871a83-35a9-5e5d-b68b-e4851dd91c8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f1/9ef113fce575cb3d2ba16ecbf1b34757/pa/GJ08711_d6a36140433b9e0e4eedd2989e37fbda.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ08711%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [auto1.nl] INFO: Saving data for GJ08711: {'created_time': 1774638686.637847, 'last_price_update_time': 1774638686.637857, 'auction_closing_time': 1774715414.0}
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GJ08711') HTTP/1.1" 204 0
2026-03-27 19:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 13c5a2a9-069e-55fd-82a7-168c511833a3 with identifier: XC91044
2026-03-27 19:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 13c5a2a9-069e-55fd-82a7-168c511833a3 with identifier: XC91044
2026-03-27 19:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 13c5a2a9-069e-55fd-82a7-168c511833a3 with identifier: XC91044 to the API
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:18:58Z',
 'fuel_type': 'diesel',
 'id': '13c5a2a9-069e-55fd-82a7-168c511833a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC91044',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 159310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-20',
 'seller_name': None,
 'title': 'Renault Master 2.3 BLUE dCi L2H2 HKa 3,5t Doka',
 'transmission': 'manual',
 'trim': 'L2H2 HKa 3,5t Doka',
 'year': 2022}
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC91044%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [auto1.nl] INFO: Saving data for XC91044: {'auction_closing_time': 1774714738.0, 'created_time': 1773861262.480845, 'last_price_update_time': 1774638686.928851}
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XC91044') HTTP/1.1" 204 0
2026-03-27 19:11:26 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-27 19:11:26 [auto1.nl] INFO: Found listing with ID: CM13419
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM13419%27 HTTP/1.1" 200 None
2026-03-27 19:11:26 [auto1.nl] INFO: Scrape type for CM13419: 2
2026-03-27 19:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86e2ef4c-b17c-5a96-b3df-c5bc11c1e4cc with identifier: CM13419
2026-03-27 19:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86e2ef4c-b17c-5a96-b3df-c5bc11c1e4cc with scrape type 2
2026-03-27 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86e2ef4c-b17c-5a96-b3df-c5bc11c1e4cc with scrape type 2
2026-03-27 19:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 86e2ef4c-b17c-5a96-b3df-c5bc11c1e4cc, identifier: CM13419
2026-03-27 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ35389> (referer: https://www.auto1.com/v1/car-details-view/JZ35389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL48318> (referer: https://www.auto1.com/v1/car-details-view/HL48318/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 86e2ef4c-b17c-5a96-b3df-c5bc11c1e4cc with identifier: CM13419
2026-03-27 19:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 86e2ef4c-b17c-5a96-b3df-c5bc11c1e4cc with identifier: CM13419
2026-03-27 19:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 86e2ef4c-b17c-5a96-b3df-c5bc11c1e4cc with identifier: CM13419 to the API
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:39Z',
 'fuel_type': 'petrol',
 'id': '86e2ef4c-b17c-5a96-b3df-c5bc11c1e4cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM13419',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 216944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-25',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.4 TSI Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Style BlueMotion',
 'year': 2012}
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM13419%27 HTTP/1.1" 200 None
2026-03-27 19:11:27 [auto1.nl] INFO: Saving data for CM13419: {'auction_closing_time': 1774716999.0, 'created_time': 1773861294.497806, 'last_price_update_time': 1774638687.309192}
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CM13419') HTTP/1.1" 204 0
2026-03-27 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5ecbe653f816140f0b7c30d499887f2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:27 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-27 19:11:27 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-27 19:11:27 [auto1.nl] INFO: Found listing with ID: EX83153
2026-03-27 19:11:27 [auto1.nl] INFO: Found listing with ID: DL78347
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL78347%27 HTTP/1.1" 200 None
2026-03-27 19:11:27 [auto1.nl] INFO: Scrape type for DL78347: 1
2026-03-27 19:11:27 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-27 19:11:27 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-27 19:11:27 [auto1.nl] INFO: Found listing with ID: DX59899
2026-03-27 19:11:27 [auto1.nl] INFO: Found listing with ID: EJ17993
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ17993%27 HTTP/1.1" 200 None
2026-03-27 19:11:27 [auto1.nl] INFO: Scrape type for EJ17993: 2
2026-03-27 19:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f90a6a2-c55c-5155-b23f-c186180c8c48 with identifier: EJ17993
2026-03-27 19:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f90a6a2-c55c-5155-b23f-c186180c8c48 with scrape type 2
2026-03-27 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f90a6a2-c55c-5155-b23f-c186180c8c48 with scrape type 2
2026-03-27 19:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1f90a6a2-c55c-5155-b23f-c186180c8c48, identifier: EJ17993
2026-03-27 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM87332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX28541> (referer: https://www.auto1.com/v1/car-details-view/AX28541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1f90a6a2-c55c-5155-b23f-c186180c8c48 with identifier: EJ17993
2026-03-27 19:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1f90a6a2-c55c-5155-b23f-c186180c8c48 with identifier: EJ17993
2026-03-27 19:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1f90a6a2-c55c-5155-b23f-c186180c8c48 with identifier: EJ17993 to the API
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:50:48Z',
 'fuel_type': 'petrol',
 'id': '1f90a6a2-c55c-5155-b23f-c186180c8c48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ17993',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 111460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ17993%27 HTTP/1.1" 200 None
2026-03-27 19:11:27 [auto1.nl] INFO: Saving data for EJ17993: {'auction_closing_time': 1774716648.0, 'created_time': 1773232251.113635, 'last_price_update_time': 1774638687.722368}
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EJ17993') HTTP/1.1" 204 0
2026-03-27 19:11:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389
2026-03-27 19:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with scrape type 1
2026-03-27 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fc6%252F55c6f3db77de0bd669a1dc1500307b67%252Fpa%252FJZ35389_5dbea1c828b3cac9e6c84a3f91e90807.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_5dbea1c828b3cac9e6c84a3f91e90807.jpg already downloaded
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fc6%252F55c6f3db77de0bd669a1dc1500307b67%252Fpa%252FJZ35389_d3a1ff93db4307d8b53be90fba16254e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_d3a1ff93db4307d8b53be90fba16254e.jpg already downloaded
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fc6%252F55c6f3db77de0bd669a1dc1500307b67%252Fpa%252FJZ35389_a288d86f1669dac75ce14f5f0a34878b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_a288d86f1669dac75ce14f5f0a34878b.jpg already downloaded
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fc6%252F55c6f3db77de0bd669a1dc1500307b67%252Fpa%252FJZ35389_40bbc5e17ac11964847aa9653c6a423c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_40bbc5e17ac11964847aa9653c6a423c.jpg already downloaded
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fc6%252F55c6f3db77de0bd669a1dc1500307b67%252Fpa%252FJZ35389_3ccfa21751b8673a6ced380ec8008f75.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_3ccfa21751b8673a6ced380ec8008f75.jpg already downloaded
2026-03-27 19:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9, identifier: JZ35389
2026-03-27 19:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 031f045d-7bee-56d9-bda1-c98511701b3d with identifier: HL48318
2026-03-27 19:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 031f045d-7bee-56d9-bda1-c98511701b3d with scrape type 1
2026-03-27 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 031f045d-7bee-56d9-bda1-c98511701b3d
2026-03-27 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_268644f75e91f223530edcbe75c5c227.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_268644f75e91f223530edcbe75c5c227.jpg already downloaded
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_e94e26dbf7518d7dd3292ccee1ce4f64.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_e94e26dbf7518d7dd3292ccee1ce4f64.jpg already downloaded
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_386d09a07af16c62d9bfc9be27a103d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_386d09a07af16c62d9bfc9be27a103d3.jpg already downloaded
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_c801747bcdee1cc76a40ad6b9492559a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_c801747bcdee1cc76a40ad6b9492559a.jpg already downloaded
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_b55838f861c3d4eb6d7ffa2465340833.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_b55838f861c3d4eb6d7ffa2465340833.jpg already downloaded
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_8b1b0f454a7ebb268c87cfa4c37acfa4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_8b1b0f454a7ebb268c87cfa4c37acfa4.jpg already downloaded
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_9574a33e477ea5dbb5aea3123916e7c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_9574a33e477ea5dbb5aea3123916e7c7.jpg already downloaded
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_beba3677acdd35054b2fea195e95395d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_beba3677acdd35054b2fea195e95395d.jpg already downloaded
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_ec9875073d5071595e2f5d5b1b32a117.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_ec9875073d5071595e2f5d5b1b32a117.jpg already downloaded
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa9%252F14a92545e46855a8301dbd80482041b6%252Fpa%252FHL48318_a8c35f7d6afd691808ab487fd726579f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_a8c35f7d6afd691808ab487fd726579f.jpg already downloaded
2026-03-27 19:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 031f045d-7bee-56d9-bda1-c98511701b3d, identifier: HL48318
2026-03-27 19:11:28 [auto1.nl] INFO: Found listing with ID: WS72354
2026-03-27 19:11:28 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [auto1.nl] INFO: Scrape type for FD56899: 2
2026-03-27 19:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899
2026-03-27 19:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9744a992-e104-5296-830e-f83dba490145 with scrape type 2
2026-03-27 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9744a992-e104-5296-830e-f83dba490145 with scrape type 2
2026-03-27 19:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9744a992-e104-5296-830e-f83dba490145, identifier: FD56899
2026-03-27 19:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389
2026-03-27 19:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389
2026-03-27 19:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389 to the API
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JZ35389>
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:12:33Z',
 'fuel_type': 'petrol',
 'id': '93cd7e3d-d7ce-5e33-ba36-2162454e8cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '07JTVD',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ35389',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Saab',
 'model': '9-3',
 'odometer': 273610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_5dbea1c828b3cac9e6c84a3f91e90807.jpg',
                'https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_d3a1ff93db4307d8b53be90fba16254e.jpg',
                'https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_a288d86f1669dac75ce14f5f0a34878b.jpg',
                'https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_40bbc5e17ac11964847aa9653c6a423c.jpg',
                'https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_3ccfa21751b8673a6ced380ec8008f75.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd7e3d-d7ce-5e33-ba36-2162454e8cb9/93cd7e3d-d7ce-5e33-ba36-2162454e8cb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_5dbea1c828b3cac9e6c84a3f91e90807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd7e3d-d7ce-5e33-ba36-2162454e8cb9/93cd7e3d-d7ce-5e33-ba36-2162454e8cb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_d3a1ff93db4307d8b53be90fba16254e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd7e3d-d7ce-5e33-ba36-2162454e8cb9/93cd7e3d-d7ce-5e33-ba36-2162454e8cb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_a288d86f1669dac75ce14f5f0a34878b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd7e3d-d7ce-5e33-ba36-2162454e8cb9/93cd7e3d-d7ce-5e33-ba36-2162454e8cb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_40bbc5e17ac11964847aa9653c6a423c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd7e3d-d7ce-5e33-ba36-2162454e8cb9/93cd7e3d-d7ce-5e33-ba36-2162454e8cb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/c6/55c6f3db77de0bd669a1dc1500307b67/pa/JZ35389_3ccfa21751b8673a6ced380ec8008f75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Saab 9-3 2.0 T',
 'transmission': 'manual',
 'trim': 'T',
 'year': 2002}
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [auto1.nl] INFO: Saving data for JZ35389: {'created_time': 1774638688.620834, 'last_price_update_time': 1774638688.620846, 'auction_closing_time': 1774714353.0}
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JZ35389') HTTP/1.1" 204 0
2026-03-27 19:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 031f045d-7bee-56d9-bda1-c98511701b3d with identifier: HL48318
2026-03-27 19:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 031f045d-7bee-56d9-bda1-c98511701b3d with identifier: HL48318
2026-03-27 19:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 031f045d-7bee-56d9-bda1-c98511701b3d with identifier: HL48318 to the API
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL48318>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': 'Taxi',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:21Z',
 'fuel_type': 'diesel',
 'id': '031f045d-7bee-56d9-bda1-c98511701b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KB186R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL48318',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 276795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_268644f75e91f223530edcbe75c5c227.jpg',
                'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_e94e26dbf7518d7dd3292ccee1ce4f64.jpg',
                'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_386d09a07af16c62d9bfc9be27a103d3.jpg',
                'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_c801747bcdee1cc76a40ad6b9492559a.jpg',
                'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_b55838f861c3d4eb6d7ffa2465340833.jpg',
                'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_8b1b0f454a7ebb268c87cfa4c37acfa4.jpg',
                'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_9574a33e477ea5dbb5aea3123916e7c7.jpg',
                'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_beba3677acdd35054b2fea195e95395d.jpg',
                'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_ec9875073d5071595e2f5d5b1b32a117.jpg',
                'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_a8c35f7d6afd691808ab487fd726579f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_268644f75e91f223530edcbe75c5c227.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_e94e26dbf7518d7dd3292ccee1ce4f64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_386d09a07af16c62d9bfc9be27a103d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_c801747bcdee1cc76a40ad6b9492559a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_b55838f861c3d4eb6d7ffa2465340833.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_8b1b0f454a7ebb268c87cfa4c37acfa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_9574a33e477ea5dbb5aea3123916e7c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_beba3677acdd35054b2fea195e95395d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_ec9875073d5071595e2f5d5b1b32a117.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031f045d-7bee-56d9-bda1-c98511701b3d/031f045d-7bee-56d9-bda1-c98511701b3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a9/14a92545e46855a8301dbd80482041b6/pa/HL48318_a8c35f7d6afd691808ab487fd726579f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL48318%27 HTTP/1.1" 200 None
2026-03-27 19:11:28 [auto1.nl] INFO: Saving data for HL48318: {'created_time': 1774638688.921626, 'last_price_update_time': 1774638688.921635, 'auction_closing_time': 1774714161.0}
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HL48318') HTTP/1.1" 204 0
2026-03-27 19:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_0bf9a0057c2b5220299af2a2f0289703.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899
2026-03-27 19:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899
2026-03-27 19:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899 to the API
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:39:35Z',
 'fuel_type': 'petrol',
 'id': '9744a992-e104-5296-830e-f83dba490145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD56899',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Wagon',
 'odometer': 150881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-14',
 'seller_name': None,
 'title': 'Suzuki Wagon 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-27 19:11:29 [auto1.nl] INFO: Saving data for FD56899: {'auction_closing_time': 1774715975.0, 'created_time': 1774465828.242712, 'last_price_update_time': 1774638689.840081}
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD56899') HTTP/1.1" 204 0
2026-03-27 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ96412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3416dd0>
2026-03-27 19:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_5ecbe653f816140f0b7c30d499887f2c.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5ecbe653f816140f0b7c30d499887f2c.jpg saved to cache
2026-03-27 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:29 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-27 19:11:29 [auto1.nl] INFO: Scrape type for AW61305: 1
2026-03-27 19:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with identifier: AX28541
2026-03-27 19:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with scrape type 1
2026-03-27 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_dd8d6377a29a98e127a8f3c683f37b46.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_dd8d6377a29a98e127a8f3c683f37b46.jpg not downloaded yet
2026-03-27 19:11:30 [auto1.nl] INFO: Found listing with ID: NL82021
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL82021%27 HTTP/1.1" 200 None
2026-03-27 19:11:30 [auto1.nl] INFO: Scrape type for NL82021: 2
2026-03-27 19:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b405ea08-ebce-5fd2-9db0-7d95c63e26c2 with identifier: NL82021
2026-03-27 19:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b405ea08-ebce-5fd2-9db0-7d95c63e26c2 with scrape type 2
2026-03-27 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b405ea08-ebce-5fd2-9db0-7d95c63e26c2 with scrape type 2
2026-03-27 19:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b405ea08-ebce-5fd2-9db0-7d95c63e26c2, identifier: NL82021
2026-03-27 19:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b405ea08-ebce-5fd2-9db0-7d95c63e26c2 with identifier: NL82021
2026-03-27 19:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b405ea08-ebce-5fd2-9db0-7d95c63e26c2 with identifier: NL82021
2026-03-27 19:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b405ea08-ebce-5fd2-9db0-7d95c63e26c2 with identifier: NL82021 to the API
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:16:03Z',
 'fuel_type': 'diesel',
 'id': 'b405ea08-ebce-5fd2-9db0-7d95c63e26c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL82021',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 86101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2020}
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL82021%27 HTTP/1.1" 200 None
2026-03-27 19:11:30 [auto1.nl] INFO: Saving data for NL82021: {'auction_closing_time': 1774714563.0, 'created_time': 1773924766.949213, 'last_price_update_time': 1774638690.37606}
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL82021') HTTP/1.1" 204 0
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_948e6534077bed5228857d322277731b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_948e6534077bed5228857d322277731b.jpg not downloaded yet
2026-03-27 19:11:30 [auto1.nl] INFO: Found listing with ID: CR11915
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR11915%27 HTTP/1.1" 200 None
2026-03-27 19:11:30 [auto1.nl] INFO: Scrape type for CR11915: 2
2026-03-27 19:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d54c7e5-73a2-52a1-877d-7fe9a2ebd2b2 with identifier: CR11915
2026-03-27 19:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d54c7e5-73a2-52a1-877d-7fe9a2ebd2b2 with scrape type 2
2026-03-27 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d54c7e5-73a2-52a1-877d-7fe9a2ebd2b2 with scrape type 2
2026-03-27 19:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1d54c7e5-73a2-52a1-877d-7fe9a2ebd2b2, identifier: CR11915
2026-03-27 19:11:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35f0bd0>
2026-03-27 19:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F18%252F1718748e93978a506bdd4f2860feae53%252Fpa%252FGD99184_0bf9a0057c2b5220299af2a2f0289703.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_0bf9a0057c2b5220299af2a2f0289703.jpg saved to cache
2026-03-27 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 882b646f-7bf7-5945-bd5a-537463b8139c
2026-03-27 19:11:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 882b646f-7bf7-5945-bd5a-537463b8139c, skipping ID generation
2026-03-27 19:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882b646f-7bf7-5945-bd5a-537463b8139c with scrape type 1
2026-03-27 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 882b646f-7bf7-5945-bd5a-537463b8139c sending to next pipeline
2026-03-27 19:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 882b646f-7bf7-5945-bd5a-537463b8139c, identifier: GD99184
2026-03-27 19:11:30 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 916 | hits on page: 40
2026-03-27 19:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1d54c7e5-73a2-52a1-877d-7fe9a2ebd2b2 with identifier: CR11915
2026-03-27 19:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1d54c7e5-73a2-52a1-877d-7fe9a2ebd2b2 with identifier: CR11915
2026-03-27 19:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1d54c7e5-73a2-52a1-877d-7fe9a2ebd2b2 with identifier: CR11915 to the API
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:42:52Z',
 'fuel_type': 'petrol',
 'id': '1d54c7e5-73a2-52a1-877d-7fe9a2ebd2b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR11915',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 16500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-20',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Mild-Hybrid Evolution',
 'transmission': 'automatic',
 'trim': 'Evolution',
 'year': 2023}
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR11915%27 HTTP/1.1" 200 None
2026-03-27 19:11:31 [auto1.nl] INFO: Saving data for CR11915: {'auction_closing_time': 1774716172.0, 'created_time': 1774465953.728484, 'last_price_update_time': 1774638691.032692}
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR11915') HTTP/1.1" 204 0
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_424bb00105b34b3e32ac90c828129b31.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_424bb00105b34b3e32ac90c828129b31.jpg not downloaded yet
2026-03-27 19:11:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 882b646f-7bf7-5945-bd5a-537463b8139c with identifier: GD99184
2026-03-27 19:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 882b646f-7bf7-5945-bd5a-537463b8139c with identifier: GD99184
2026-03-27 19:11:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 882b646f-7bf7-5945-bd5a-537463b8139c with identifier: GD99184 to the API
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_0bf9a0057c2b5220299af2a2f0289703.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 374,
 'expiration_date': '2026-03-28T16:46:22Z',
 'fuel_type': 'hybrid',
 'id': '882b646f-7bf7-5945-bd5a-537463b8139c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P900FT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD99184',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 204820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5ecbe653f816140f0b7c30d499887f2c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_278a54526845b6a5e8453362073401c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_a0c8c3ee7d48305b984e8d88255eface.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_1fa626ba5875fc7750d64488b8925519.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2280694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_0bf9a0057c2b5220299af2a2f0289703.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_609afd926f9c8a3b33b25bcb6ef2b104.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5a8d0f5d1cb993dbbeac97798a80849c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_01b7a81974a21de0f74e39efcb7a5a7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_5f0440ceeec1c646ded901c63ce99904.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882b646f-7bf7-5945-bd5a-537463b8139c/882b646f-7bf7-5945-bd5a-537463b8139c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/18/1718748e93978a506bdd4f2860feae53/pa/GD99184_b8f7e2a4b1b3dd98ab81d0c3b15fc46f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q7 3.0 TDI e-tron quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-27 19:11:31 [auto1.nl] INFO: Saving data for GD99184: {'created_time': 1774638691.59228, 'last_price_update_time': 1774638691.592292, 'auction_closing_time': 1774716382.0}
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD99184') HTTP/1.1" 204 0
2026-03-27 19:11:31 [auto1.nl] INFO: Found listing with ID: RD71224
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD71224%27 HTTP/1.1" 200 None
2026-03-27 19:11:31 [auto1.nl] INFO: Scrape type for RD71224: 2
2026-03-27 19:11:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b471ad-b3fc-56f1-abcf-a334c3fcdcd0 with identifier: RD71224
2026-03-27 19:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b471ad-b3fc-56f1-abcf-a334c3fcdcd0 with scrape type 2
2026-03-27 19:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b471ad-b3fc-56f1-abcf-a334c3fcdcd0 with scrape type 2
2026-03-27 19:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 65b471ad-b3fc-56f1-abcf-a334c3fcdcd0, identifier: RD71224
2026-03-27 19:11:31 [auto1.nl] INFO: Found listing with ID: WM00486
2026-03-27 19:11:31 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE73966%27 HTTP/1.1" 200 None
2026-03-27 19:11:31 [auto1.nl] INFO: Scrape type for SE73966: 2
2026-03-27 19:11:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c8133c-5452-586c-9a33-e557eb6a2c83 with identifier: SE73966
2026-03-27 19:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c8133c-5452-586c-9a33-e557eb6a2c83 with scrape type 2
2026-03-27 19:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9c8133c-5452-586c-9a33-e557eb6a2c83 with scrape type 2
2026-03-27 19:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c9c8133c-5452-586c-9a33-e557eb6a2c83, identifier: SE73966
2026-03-27 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 65b471ad-b3fc-56f1-abcf-a334c3fcdcd0 with identifier: RD71224
2026-03-27 19:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 65b471ad-b3fc-56f1-abcf-a334c3fcdcd0 with identifier: RD71224
2026-03-27 19:11:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 65b471ad-b3fc-56f1-abcf-a334c3fcdcd0 with identifier: RD71224 to the API
2026-03-27 19:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:04:25Z',
 'fuel_type': 'petrol',
 'id': '65b471ad-b3fc-56f1-abcf-a334c3fcdcd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD71224',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Roadster',
 'odometer': 88634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-13',
 'seller_name': None,
 'title': 'MINI Roadster Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD71224%27 HTTP/1.1" 200 None
2026-03-27 19:11:32 [auto1.nl] INFO: Saving data for RD71224: {'auction_closing_time': 1774713865.0, 'created_time': 1774465959.435299, 'last_price_update_time': 1774638692.119977}
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD71224') HTTP/1.1" 204 0
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_cee4a2bbd536be956002635519430fe0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_cee4a2bbd536be956002635519430fe0.jpg not downloaded yet
2026-03-27 19:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c9c8133c-5452-586c-9a33-e557eb6a2c83 with identifier: SE73966
2026-03-27 19:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c9c8133c-5452-586c-9a33-e557eb6a2c83 with identifier: SE73966
2026-03-27 19:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c9c8133c-5452-586c-9a33-e557eb6a2c83 with identifier: SE73966 to the API
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:24:39Z',
 'fuel_type': 'petrol',
 'id': 'c9c8133c-5452-586c-9a33-e557eb6a2c83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE73966',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 76539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-08',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2019}
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE73966%27 HTTP/1.1" 200 None
2026-03-27 19:11:32 [auto1.nl] INFO: Saving data for SE73966: {'auction_closing_time': 1774715079.0, 'created_time': 1774465854.617021, 'last_price_update_time': 1774638692.429133}
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE73966') HTTP/1.1" 204 0
2026-03-27 19:11:32 [auto1.nl] INFO: Found listing with ID: TV97350
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV97350%27 HTTP/1.1" 200 None
2026-03-27 19:11:32 [auto1.nl] INFO: Scrape type for TV97350: 2
2026-03-27 19:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29e42e62-9866-5cf2-b239-20824715da40 with identifier: TV97350
2026-03-27 19:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29e42e62-9866-5cf2-b239-20824715da40 with scrape type 2
2026-03-27 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29e42e62-9866-5cf2-b239-20824715da40 with scrape type 2
2026-03-27 19:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 29e42e62-9866-5cf2-b239-20824715da40, identifier: TV97350
2026-03-27 19:11:32 [auto1.nl] INFO: Found listing with ID: YM72619
2026-03-27 19:11:32 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-27 19:11:32 [auto1.nl] INFO: Found listing with ID: BB30302
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB30302%27 HTTP/1.1" 200 None
2026-03-27 19:11:32 [auto1.nl] INFO: Scrape type for BB30302: 2
2026-03-27 19:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8966d50-357e-59de-9522-59b2ba52b38d with identifier: BB30302
2026-03-27 19:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8966d50-357e-59de-9522-59b2ba52b38d with scrape type 2
2026-03-27 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8966d50-357e-59de-9522-59b2ba52b38d with scrape type 2
2026-03-27 19:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c8966d50-357e-59de-9522-59b2ba52b38d, identifier: BB30302
2026-03-27 19:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_dd8d6377a29a98e127a8f3c683f37b46.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 29e42e62-9866-5cf2-b239-20824715da40 with identifier: TV97350
2026-03-27 19:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 29e42e62-9866-5cf2-b239-20824715da40 with identifier: TV97350
2026-03-27 19:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 29e42e62-9866-5cf2-b239-20824715da40 with identifier: TV97350 to the API
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:31:49Z',
 'fuel_type': 'diesel',
 'id': '29e42e62-9866-5cf2-b239-20824715da40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV97350',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 352451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-28',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2010}
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV97350%27 HTTP/1.1" 200 None
2026-03-27 19:11:32 [auto1.nl] INFO: Saving data for TV97350: {'auction_closing_time': 1774715509.0, 'created_time': 1773405271.644091, 'last_price_update_time': 1774638692.927495}
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TV97350') HTTP/1.1" 204 0
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_3302d3cc96cff5ddf202ce4a88bc7ed8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_3302d3cc96cff5ddf202ce4a88bc7ed8.jpg not downloaded yet
2026-03-27 19:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c8966d50-357e-59de-9522-59b2ba52b38d with identifier: BB30302
2026-03-27 19:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c8966d50-357e-59de-9522-59b2ba52b38d with identifier: BB30302
2026-03-27 19:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c8966d50-357e-59de-9522-59b2ba52b38d with identifier: BB30302 to the API
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:29:37Z',
 'fuel_type': 'diesel',
 'id': 'c8966d50-357e-59de-9522-59b2ba52b38d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB30302',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 204874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-30',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2009}
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB30302%27 HTTP/1.1" 200 None
2026-03-27 19:11:33 [auto1.nl] INFO: Saving data for BB30302: {'auction_closing_time': 1774715377.0, 'created_time': 1773232380.17668, 'last_price_update_time': 1774638693.315515}
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BB30302') HTTP/1.1" 204 0
2026-03-27 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL78347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_948e6534077bed5228857d322277731b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:33 [auto1.nl] INFO: Found listing with ID: BA20726
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA20726%27 HTTP/1.1" 200 None
2026-03-27 19:11:33 [auto1.nl] INFO: Scrape type for BA20726: 2
2026-03-27 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4616c8a3-4b44-5d05-8b3a-761314cf0d81 with identifier: BA20726
2026-03-27 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4616c8a3-4b44-5d05-8b3a-761314cf0d81 with scrape type 2
2026-03-27 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4616c8a3-4b44-5d05-8b3a-761314cf0d81 with scrape type 2
2026-03-27 19:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4616c8a3-4b44-5d05-8b3a-761314cf0d81, identifier: BA20726
2026-03-27 19:11:33 [auto1.nl] INFO: Found listing with ID: EM31499
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM31499%27 HTTP/1.1" 200 None
2026-03-27 19:11:33 [auto1.nl] INFO: Scrape type for EM31499: 1
2026-03-27 19:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4616c8a3-4b44-5d05-8b3a-761314cf0d81 with identifier: BA20726
2026-03-27 19:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4616c8a3-4b44-5d05-8b3a-761314cf0d81 with identifier: BA20726
2026-03-27 19:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4616c8a3-4b44-5d05-8b3a-761314cf0d81 with identifier: BA20726 to the API
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:16:30Z',
 'fuel_type': 'petrol',
 'id': '4616c8a3-4b44-5d05-8b3a-761314cf0d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA20726',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 131934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA20726%27 HTTP/1.1" 200 None
2026-03-27 19:11:33 [auto1.nl] INFO: Saving data for BA20726: {'auction_closing_time': 1774714590.0, 'created_time': 1773404648.97243, 'last_price_update_time': 1774638693.70276}
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BA20726') HTTP/1.1" 204 0
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_11cf8c25e4209205d4fd9ab9961aa0d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_11cf8c25e4209205d4fd9ab9961aa0d6.jpg not downloaded yet
2026-03-27 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_424bb00105b34b3e32ac90c828129b31.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:33 [auto1.nl] INFO: Found listing with ID: YT17806
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT17806%27 HTTP/1.1" 200 None
2026-03-27 19:11:33 [auto1.nl] INFO: Scrape type for YT17806: 2
2026-03-27 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4a64c14-26b8-5b00-925b-47d50f080575 with identifier: YT17806
2026-03-27 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a64c14-26b8-5b00-925b-47d50f080575 with scrape type 2
2026-03-27 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4a64c14-26b8-5b00-925b-47d50f080575 with scrape type 2
2026-03-27 19:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f4a64c14-26b8-5b00-925b-47d50f080575, identifier: YT17806
2026-03-27 19:11:33 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU03556%27 HTTP/1.1" 200 None
2026-03-27 19:11:33 [auto1.nl] INFO: Scrape type for CU03556: 2
2026-03-27 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 322f98a1-e741-516d-9c31-dfa249f9fab1 with identifier: CU03556
2026-03-27 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 322f98a1-e741-516d-9c31-dfa249f9fab1 with scrape type 2
2026-03-27 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 322f98a1-e741-516d-9c31-dfa249f9fab1 with scrape type 2
2026-03-27 19:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 322f98a1-e741-516d-9c31-dfa249f9fab1, identifier: CU03556
2026-03-27 19:11:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34d14d0>
2026-03-27 19:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_dd8d6377a29a98e127a8f3c683f37b46.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_dd8d6377a29a98e127a8f3c683f37b46.jpg saved to cache
2026-03-27 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f4a64c14-26b8-5b00-925b-47d50f080575 with identifier: YT17806
2026-03-27 19:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f4a64c14-26b8-5b00-925b-47d50f080575 with identifier: YT17806
2026-03-27 19:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f4a64c14-26b8-5b00-925b-47d50f080575 with identifier: YT17806 to the API
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:13:36Z',
 'fuel_type': 'diesel',
 'id': 'f4a64c14-26b8-5b00-925b-47d50f080575',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT17806',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 283486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-16',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 2.0 JTDM Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2011}
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT17806%27 HTTP/1.1" 200 None
2026-03-27 19:11:34 [auto1.nl] INFO: Saving data for YT17806: {'auction_closing_time': 1774714416.0, 'created_time': 1773405129.993811, 'last_price_update_time': 1774638694.231432}
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YT17806') HTTP/1.1" 204 0
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_d5b0d591b6d6b760274030985fcc7228.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_d5b0d591b6d6b760274030985fcc7228.jpg not downloaded yet
2026-03-27 19:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 322f98a1-e741-516d-9c31-dfa249f9fab1 with identifier: CU03556
2026-03-27 19:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 322f98a1-e741-516d-9c31-dfa249f9fab1 with identifier: CU03556
2026-03-27 19:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 322f98a1-e741-516d-9c31-dfa249f9fab1 with identifier: CU03556 to the API
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:36:49Z',
 'fuel_type': 'petrol',
 'id': '322f98a1-e741-516d-9c31-dfa249f9fab1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU03556',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 117012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2019}
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU03556%27 HTTP/1.1" 200 None
2026-03-27 19:11:34 [auto1.nl] INFO: Saving data for CU03556: {'auction_closing_time': 1774715809.0, 'created_time': 1773132708.275272, 'last_price_update_time': 1774638694.615996}
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CU03556') HTTP/1.1" 204 0
2026-03-27 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_cee4a2bbd536be956002635519430fe0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:34 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-27 19:11:34 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-27 19:11:34 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-27 19:11:34 [auto1.nl] INFO: Scrape type for SY92282: 1
2026-03-27 19:11:34 [auto1.nl] INFO: Found listing with ID: UB53809
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB53809%27 HTTP/1.1" 200 None
2026-03-27 19:11:34 [auto1.nl] INFO: Scrape type for UB53809: 2
2026-03-27 19:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8703e3e7-9c72-57bb-bc14-fbac21cc8a51 with identifier: UB53809
2026-03-27 19:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8703e3e7-9c72-57bb-bc14-fbac21cc8a51 with scrape type 2
2026-03-27 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8703e3e7-9c72-57bb-bc14-fbac21cc8a51 with scrape type 2
2026-03-27 19:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8703e3e7-9c72-57bb-bc14-fbac21cc8a51, identifier: UB53809
2026-03-27 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32cca90>
2026-03-27 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_948e6534077bed5228857d322277731b.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_948e6534077bed5228857d322277731b.jpg saved to cache
2026-03-27 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_0e0c4545658299e228840f832f01e1eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_0e0c4545658299e228840f832f01e1eb.jpg not downloaded yet
2026-03-27 19:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8703e3e7-9c72-57bb-bc14-fbac21cc8a51 with identifier: UB53809
2026-03-27 19:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8703e3e7-9c72-57bb-bc14-fbac21cc8a51 with identifier: UB53809
2026-03-27 19:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8703e3e7-9c72-57bb-bc14-fbac21cc8a51 with identifier: UB53809 to the API
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:03:59Z',
 'fuel_type': 'diesel',
 'id': '8703e3e7-9c72-57bb-bc14-fbac21cc8a51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB53809',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 138733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-14',
 'seller_name': None,
 'title': 'Opel Movano 2.3 CDTI HKa L2H2 3,3t',
 'transmission': 'manual',
 'trim': 'HKa L2H2 3,3t',
 'year': 2016}
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB53809%27 HTTP/1.1" 200 None
2026-03-27 19:11:35 [auto1.nl] INFO: Saving data for UB53809: {'auction_closing_time': 1774713839.0, 'created_time': 1773131947.253911, 'last_price_update_time': 1774638695.060789}
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB53809') HTTP/1.1" 204 0
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-27 19:11:35 [auto1.nl] INFO: Scrape type for UY18740: 1
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: EL08717
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: HL89699
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL89699%27 HTTP/1.1" 200 None
2026-03-27 19:11:35 [auto1.nl] INFO: Scrape type for HL89699: 1
2026-03-27 19:11:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae291b190>
2026-03-27 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_424bb00105b34b3e32ac90c828129b31.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_424bb00105b34b3e32ac90c828129b31.jpg saved to cache
2026-03-27 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_3302d3cc96cff5ddf202ce4a88bc7ed8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_f2143d98401ab156c283deef01acae6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_f2143d98401ab156c283deef01acae6b.jpg not downloaded yet
2026-03-27 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_11cf8c25e4209205d4fd9ab9961aa0d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-27 19:11:35 [auto1.nl] INFO: Scrape type for XW90615: 1
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: NB67844
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: TY02674
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: FR73964
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR73964%27 HTTP/1.1" 200 None
2026-03-27 19:11:35 [auto1.nl] INFO: Scrape type for FR73964: 2
2026-03-27 19:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00d33d9e-71dc-553e-ba50-99d75e6a2037 with identifier: FR73964
2026-03-27 19:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00d33d9e-71dc-553e-ba50-99d75e6a2037 with scrape type 2
2026-03-27 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00d33d9e-71dc-553e-ba50-99d75e6a2037 with scrape type 2
2026-03-27 19:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 00d33d9e-71dc-553e-ba50-99d75e6a2037, identifier: FR73964
2026-03-27 19:11:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2942490>
2026-03-27 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_cee4a2bbd536be956002635519430fe0.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_cee4a2bbd536be956002635519430fe0.jpg saved to cache
2026-03-27 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_0e86cb0a84a574d927f685f7cb28d3f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_0e86cb0a84a574d927f685f7cb28d3f0.jpg not downloaded yet
2026-03-27 19:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 00d33d9e-71dc-553e-ba50-99d75e6a2037 with identifier: FR73964
2026-03-27 19:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 00d33d9e-71dc-553e-ba50-99d75e6a2037 with identifier: FR73964
2026-03-27 19:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 00d33d9e-71dc-553e-ba50-99d75e6a2037 with identifier: FR73964 to the API
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:25:43Z',
 'fuel_type': 'petrol',
 'id': '00d33d9e-71dc-553e-ba50-99d75e6a2037',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR73964',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 243919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-21',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2009}
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR73964%27 HTTP/1.1" 200 None
2026-03-27 19:11:35 [auto1.nl] INFO: Saving data for FR73964: {'auction_closing_time': 1774715143.0, 'created_time': 1773132104.860321, 'last_price_update_time': 1774638695.832851}
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR73964') HTTP/1.1" 204 0
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: NL79871
2026-03-27 19:11:35 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-27 19:11:35 [auto1.nl] INFO: Scrape type for PE89486: 2
2026-03-27 19:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with identifier: PE89486
2026-03-27 19:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with scrape type 2
2026-03-27 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with scrape type 2
2026-03-27 19:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4, identifier: PE89486
2026-03-27 19:11:36 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-27 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-27 19:11:36 [auto1.nl] INFO: Scrape type for BY94157: 1
2026-03-27 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_d5b0d591b6d6b760274030985fcc7228.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with identifier: PE89486
2026-03-27 19:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with identifier: PE89486
2026-03-27 19:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with identifier: PE89486 to the API
2026-03-27 19:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:39:18Z',
 'fuel_type': 'petrol',
 'id': '3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE89486',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 122397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-14',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-27 19:11:37 [auto1.nl] INFO: Saving data for PE89486: {'auction_closing_time': 1774715958.0, 'created_time': 1773947586.840336, 'last_price_update_time': 1774638697.574148}
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PE89486') HTTP/1.1" 204 0
2026-03-27 19:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3444f50>
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_3302d3cc96cff5ddf202ce4a88bc7ed8.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_3302d3cc96cff5ddf202ce4a88bc7ed8.jpg saved to cache
2026-03-27 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35e9e90>
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_11cf8c25e4209205d4fd9ab9961aa0d6.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_11cf8c25e4209205d4fd9ab9961aa0d6.jpg saved to cache
2026-03-27 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_0e0c4545658299e228840f832f01e1eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:37 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-27 19:11:37 [auto1.nl] INFO: Found listing with ID: MZ83148
2026-03-27 19:11:37 [auto1.nl] INFO: Found listing with ID: TF88410
2026-03-27 19:11:37 [auto1.nl] INFO: Found listing with ID: YK64597
2026-03-27 19:11:37 [auto1.nl] INFO: Found listing with ID: AP41268
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AP41268%27 HTTP/1.1" 200 None
2026-03-27 19:11:37 [auto1.nl] INFO: Scrape type for AP41268: 1
2026-03-27 19:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ96412> (referer: https://www.auto1.com/v1/car-details-view/FJ96412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW61305/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:37 [auto1.nl] INFO: Found listing with ID: VP87797
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP87797%27 HTTP/1.1" 200 None
2026-03-27 19:11:37 [auto1.nl] INFO: Scrape type for VP87797: 2
2026-03-27 19:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0da65e8-8ae1-5d49-972c-b70624660c92 with identifier: VP87797
2026-03-27 19:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0da65e8-8ae1-5d49-972c-b70624660c92 with scrape type 2
2026-03-27 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0da65e8-8ae1-5d49-972c-b70624660c92 with scrape type 2
2026-03-27 19:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f0da65e8-8ae1-5d49-972c-b70624660c92, identifier: VP87797
2026-03-27 19:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM87332> (referer: https://www.auto1.com/v1/car-details-view/NM87332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae93762d0>
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_d5b0d591b6d6b760274030985fcc7228.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_d5b0d591b6d6b760274030985fcc7228.jpg saved to cache
2026-03-27 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f0da65e8-8ae1-5d49-972c-b70624660c92 with identifier: VP87797
2026-03-27 19:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f0da65e8-8ae1-5d49-972c-b70624660c92 with identifier: VP87797
2026-03-27 19:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f0da65e8-8ae1-5d49-972c-b70624660c92 with identifier: VP87797 to the API
2026-03-27 19:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:07:37Z',
 'fuel_type': 'petrol',
 'id': 'f0da65e8-8ae1-5d49-972c-b70624660c92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP87797',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 190113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-09',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP87797%27 HTTP/1.1" 200 None
2026-03-27 19:11:38 [auto1.nl] INFO: Saving data for VP87797: {'auction_closing_time': 1774714057.0, 'created_time': 1773232391.129489, 'last_price_update_time': 1774638698.216004}
2026-03-27 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VP87797') HTTP/1.1" 204 0
2026-03-27 19:11:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:38 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-27 19:11:38 [auto1.nl] INFO: Found listing with ID: NS74153
2026-03-27 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS74153%27 HTTP/1.1" 200 None
2026-03-27 19:11:38 [auto1.nl] INFO: Scrape type for NS74153: 2
2026-03-27 19:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbfd17bb-5b1c-57c3-bf6c-6ef2e501eb63 with identifier: NS74153
2026-03-27 19:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbfd17bb-5b1c-57c3-bf6c-6ef2e501eb63 with scrape type 2
2026-03-27 19:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbfd17bb-5b1c-57c3-bf6c-6ef2e501eb63 with scrape type 2
2026-03-27 19:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dbfd17bb-5b1c-57c3-bf6c-6ef2e501eb63, identifier: NS74153
2026-03-27 19:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_0e86cb0a84a574d927f685f7cb28d3f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dbfd17bb-5b1c-57c3-bf6c-6ef2e501eb63 with identifier: NS74153
2026-03-27 19:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dbfd17bb-5b1c-57c3-bf6c-6ef2e501eb63 with identifier: NS74153
2026-03-27 19:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dbfd17bb-5b1c-57c3-bf6c-6ef2e501eb63 with identifier: NS74153 to the API
2026-03-27 19:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:13:21Z',
 'fuel_type': 'diesel',
 'id': 'dbfd17bb-5b1c-57c3-bf6c-6ef2e501eb63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS74153',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 412561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS74153%27 HTTP/1.1" 200 None
2026-03-27 19:11:39 [auto1.nl] INFO: Saving data for NS74153: {'auction_closing_time': 1774714401.0, 'created_time': 1773132017.503232, 'last_price_update_time': 1774638699.639991}
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NS74153') HTTP/1.1" 204 0
2026-03-27 19:11:39 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 916 | hits on page: 40
2026-03-27 19:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2943050>
2026-03-27 19:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_0e0c4545658299e228840f832f01e1eb.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_0e0c4545658299e228840f832f01e1eb.jpg saved to cache
2026-03-27 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412
2026-03-27 19:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with scrape type 1
2026-03-27 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cd56b48c-ae68-5a9f-acb0-7c2e90c15b43
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F9b%252F889ba6f6f4e65dd7ffbce2e13339e798%252Fpa%252FFJ96412_24228f30de7a7f97f3cb054525f0f547.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_24228f30de7a7f97f3cb054525f0f547.jpg already downloaded
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F9b%252F889ba6f6f4e65dd7ffbce2e13339e798%252Fpa%252FFJ96412_5df4ba9359ad1c5bd4b8bdb4e33f3dcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_5df4ba9359ad1c5bd4b8bdb4e33f3dcf.jpg already downloaded
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F9b%252F889ba6f6f4e65dd7ffbce2e13339e798%252Fpa%252FFJ96412_c8c0574ec27bf04a3556c8591217af41.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_c8c0574ec27bf04a3556c8591217af41.jpg already downloaded
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F9b%252F889ba6f6f4e65dd7ffbce2e13339e798%252Fpa%252FFJ96412_27aa8f41416a9ce9ea9949745c635771.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_27aa8f41416a9ce9ea9949745c635771.jpg already downloaded
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F9b%252F889ba6f6f4e65dd7ffbce2e13339e798%252Fpa%252FFJ96412_15b93e1e0faa4ef867a6dbb8689fc2e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_15b93e1e0faa4ef867a6dbb8689fc2e5.jpg already downloaded
2026-03-27 19:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43, identifier: FJ96412
2026-03-27 19:11:39 [auto1.nl] INFO: Found listing with ID: SM09418
2026-03-27 19:11:39 [auto1.nl] INFO: Found listing with ID: GV84229
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV84229%27 HTTP/1.1" 200 None
2026-03-27 19:11:39 [auto1.nl] INFO: Scrape type for GV84229: 1
2026-03-27 19:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM31499/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412
2026-03-27 19:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412
2026-03-27 19:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412 to the API
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ96412>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:09:31Z',
 'fuel_type': 'petrol',
 'id': 'cd56b48c-ae68-5a9f-acb0-7c2e90c15b43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '93XPVF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ96412',
 'listing': 'auction',
 'location': 'NL, Raamsdonksveer',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 155860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_24228f30de7a7f97f3cb054525f0f547.jpg',
                'https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_5df4ba9359ad1c5bd4b8bdb4e33f3dcf.jpg',
                'https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_c8c0574ec27bf04a3556c8591217af41.jpg',
                'https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_27aa8f41416a9ce9ea9949745c635771.jpg',
                'https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_15b93e1e0faa4ef867a6dbb8689fc2e5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd56b48c-ae68-5a9f-acb0-7c2e90c15b43/cd56b48c-ae68-5a9f-acb0-7c2e90c15b43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_24228f30de7a7f97f3cb054525f0f547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd56b48c-ae68-5a9f-acb0-7c2e90c15b43/cd56b48c-ae68-5a9f-acb0-7c2e90c15b43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_5df4ba9359ad1c5bd4b8bdb4e33f3dcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd56b48c-ae68-5a9f-acb0-7c2e90c15b43/cd56b48c-ae68-5a9f-acb0-7c2e90c15b43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_c8c0574ec27bf04a3556c8591217af41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd56b48c-ae68-5a9f-acb0-7c2e90c15b43/cd56b48c-ae68-5a9f-acb0-7c2e90c15b43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_27aa8f41416a9ce9ea9949745c635771.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd56b48c-ae68-5a9f-acb0-7c2e90c15b43/cd56b48c-ae68-5a9f-acb0-7c2e90c15b43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/9b/889ba6f6f4e65dd7ffbce2e13339e798/pa/FJ96412_15b93e1e0faa4ef867a6dbb8689fc2e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-04-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 307 2.0 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2004}
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [auto1.nl] INFO: Saving data for FJ96412: {'created_time': 1774638700.45358, 'last_price_update_time': 1774638700.45359, 'auction_closing_time': 1774714171.0}
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ96412') HTTP/1.1" 204 0
2026-03-27 19:11:40 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-27 19:11:40 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-27 19:11:40 [auto1.nl] INFO: Found listing with ID: FB31523
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB31523%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [auto1.nl] INFO: Scrape type for FB31523: 1
2026-03-27 19:11:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b85c05-3778-5702-9f06-4ac8cf7c9bbf with identifier: NM87332
2026-03-27 19:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b85c05-3778-5702-9f06-4ac8cf7c9bbf with scrape type 1
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9b85c05-3778-5702-9f06-4ac8cf7c9bbf
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_233296d3a7aff2f780cce97690214a12.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_233296d3a7aff2f780cce97690214a12.jpg already downloaded
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_3d7d1abc686d67dcb2b7e09ec2d7e89a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_3d7d1abc686d67dcb2b7e09ec2d7e89a.jpg already downloaded
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_c8eee98745482070c5d537662195fae9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_c8eee98745482070c5d537662195fae9.jpg already downloaded
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_edb9d2b2717c20d7f4514e9b5a25bd21.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_edb9d2b2717c20d7f4514e9b5a25bd21.jpg already downloaded
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_ecc433d291bb253e14e70aa9eefe0a73.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_ecc433d291bb253e14e70aa9eefe0a73.jpg already downloaded
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_eb4afd87dfcaff50eede568803f501be.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_eb4afd87dfcaff50eede568803f501be.jpg already downloaded
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_af4a3315ffe0ff0434c53cb37c857d10.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_af4a3315ffe0ff0434c53cb37c857d10.jpg already downloaded
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_8b120a4fe702b847675f13fa6658a1e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_8b120a4fe702b847675f13fa6658a1e0.jpg already downloaded
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_c2895dc7aa9807b0ab1cb682dcddb888.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_c2895dc7aa9807b0ab1cb682dcddb888.jpg already downloaded
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5c%252F045ce78c71b06f94f4e8dcabcc59fc8c%252Fpa%252FNM87332_cc45597cb73ab6c5eab3aedfffef5653.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_cc45597cb73ab6c5eab3aedfffef5653.jpg already downloaded
2026-03-27 19:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e9b85c05-3778-5702-9f06-4ac8cf7c9bbf, identifier: NM87332
2026-03-27 19:11:40 [auto1.nl] INFO: Found listing with ID: NN84532
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN84532%27 HTTP/1.1" 200 None
2026-03-27 19:11:40 [auto1.nl] INFO: Scrape type for NN84532: 2
2026-03-27 19:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 868a226e-4212-5724-a3ee-373cd1a093ca with identifier: NN84532
2026-03-27 19:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 868a226e-4212-5724-a3ee-373cd1a093ca with scrape type 2
2026-03-27 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 868a226e-4212-5724-a3ee-373cd1a093ca with scrape type 2
2026-03-27 19:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 868a226e-4212-5724-a3ee-373cd1a093ca, identifier: NN84532
2026-03-27 19:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL78347> (referer: https://www.auto1.com/v1/car-details-view/DL78347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e9b85c05-3778-5702-9f06-4ac8cf7c9bbf with identifier: NM87332
2026-03-27 19:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e9b85c05-3778-5702-9f06-4ac8cf7c9bbf with identifier: NM87332
2026-03-27 19:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e9b85c05-3778-5702-9f06-4ac8cf7c9bbf with identifier: NM87332 to the API
2026-03-27 19:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NM87332>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:12:22Z',
 'fuel_type': 'petrol',
 'id': 'e9b85c05-3778-5702-9f06-4ac8cf7c9bbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JG593H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM87332',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 102099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_233296d3a7aff2f780cce97690214a12.jpg',
                'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_3d7d1abc686d67dcb2b7e09ec2d7e89a.jpg',
                'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_c8eee98745482070c5d537662195fae9.jpg',
                'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_edb9d2b2717c20d7f4514e9b5a25bd21.jpg',
                'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_ecc433d291bb253e14e70aa9eefe0a73.jpg',
                'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_eb4afd87dfcaff50eede568803f501be.jpg',
                'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_af4a3315ffe0ff0434c53cb37c857d10.jpg',
                'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_8b120a4fe702b847675f13fa6658a1e0.jpg',
                'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_c2895dc7aa9807b0ab1cb682dcddb888.jpg',
                'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_cc45597cb73ab6c5eab3aedfffef5653.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_233296d3a7aff2f780cce97690214a12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_3d7d1abc686d67dcb2b7e09ec2d7e89a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_c8eee98745482070c5d537662195fae9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_edb9d2b2717c20d7f4514e9b5a25bd21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_ecc433d291bb253e14e70aa9eefe0a73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_eb4afd87dfcaff50eede568803f501be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_af4a3315ffe0ff0434c53cb37c857d10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_8b120a4fe702b847675f13fa6658a1e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_c2895dc7aa9807b0ab1cb682dcddb888.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b85c05-3778-5702-9f06-4ac8cf7c9bbf/e9b85c05-3778-5702-9f06-4ac8cf7c9bbf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5c/045ce78c71b06f94f4e8dcabcc59fc8c/pa/NM87332_cc45597cb73ab6c5eab3aedfffef5653.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-27 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM87332%27 HTTP/1.1" 200 None
2026-03-27 19:11:41 [auto1.nl] INFO: Saving data for NM87332: {'created_time': 1774638701.230356, 'last_price_update_time': 1774638701.230365, 'auction_closing_time': 1774714342.0}
2026-03-27 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NM87332') HTTP/1.1" 204 0
2026-03-27 19:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 868a226e-4212-5724-a3ee-373cd1a093ca with identifier: NN84532
2026-03-27 19:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 868a226e-4212-5724-a3ee-373cd1a093ca with identifier: NN84532
2026-03-27 19:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 868a226e-4212-5724-a3ee-373cd1a093ca with identifier: NN84532 to the API
2026-03-27 19:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:41:02Z',
 'fuel_type': 'hybrid',
 'id': '868a226e-4212-5724-a3ee-373cd1a093ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN84532',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 166052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D5 Hybrid Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2016}
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN84532%27 HTTP/1.1" 200 None
2026-03-27 19:11:42 [auto1.nl] INFO: Saving data for NN84532: {'auction_closing_time': 1774716062.0, 'created_time': 1773232363.942601, 'last_price_update_time': 1774638702.693446}
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NN84532') HTTP/1.1" 204 0
2026-03-27 19:11:42 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-27 19:11:42 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-27 19:11:42 [auto1.nl] INFO: Scrape type for KV87922: 2
2026-03-27 19:11:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 785fd0aa-717b-556e-8ca0-7e1ca1377923 with identifier: KV87922
2026-03-27 19:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 785fd0aa-717b-556e-8ca0-7e1ca1377923 with scrape type 2
2026-03-27 19:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 785fd0aa-717b-556e-8ca0-7e1ca1377923 with scrape type 2
2026-03-27 19:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 785fd0aa-717b-556e-8ca0-7e1ca1377923, identifier: KV87922
2026-03-27 19:11:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:42 [auto1.nl] INFO: Found listing with ID: YE34591
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE34591%27 HTTP/1.1" 200 None
2026-03-27 19:11:42 [auto1.nl] INFO: Scrape type for YE34591: 2
2026-03-27 19:11:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a294493a-48aa-5277-ab22-9cf4bea0397f with identifier: YE34591
2026-03-27 19:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a294493a-48aa-5277-ab22-9cf4bea0397f with scrape type 2
2026-03-27 19:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a294493a-48aa-5277-ab22-9cf4bea0397f with scrape type 2
2026-03-27 19:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a294493a-48aa-5277-ab22-9cf4bea0397f, identifier: YE34591
2026-03-27 19:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 785fd0aa-717b-556e-8ca0-7e1ca1377923 with identifier: KV87922
2026-03-27 19:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 785fd0aa-717b-556e-8ca0-7e1ca1377923 with identifier: KV87922
2026-03-27 19:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 785fd0aa-717b-556e-8ca0-7e1ca1377923 with identifier: KV87922 to the API
2026-03-27 19:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:29:26Z',
 'fuel_type': 'diesel',
 'id': '785fd0aa-717b-556e-8ca0-7e1ca1377923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV87922',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 144845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-22',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [auto1.nl] INFO: Saving data for KV87922: {'auction_closing_time': 1774715366.0, 'created_time': 1773343127.74614, 'last_price_update_time': 1774638703.280208}
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV87922') HTTP/1.1" 204 0
2026-03-27 19:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY92282/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL89699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae337db90>
2026-03-27 19:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_0e86cb0a84a574d927f685f7cb28d3f0.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_0e86cb0a84a574d927f685f7cb28d3f0.jpg saved to cache
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a294493a-48aa-5277-ab22-9cf4bea0397f with identifier: YE34591
2026-03-27 19:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a294493a-48aa-5277-ab22-9cf4bea0397f with identifier: YE34591
2026-03-27 19:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a294493a-48aa-5277-ab22-9cf4bea0397f with identifier: YE34591 to the API
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:06:08Z',
 'fuel_type': 'petrol',
 'id': 'a294493a-48aa-5277-ab22-9cf4bea0397f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE34591',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 164312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-04',
 'seller_name': None,
 'title': 'Kia Carens 2.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2008}
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE34591%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [auto1.nl] INFO: Saving data for YE34591: {'auction_closing_time': 1774713968.0, 'created_time': 1773132442.498278, 'last_price_update_time': 1774638703.755672}
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YE34591') HTTP/1.1" 204 0
2026-03-27 19:11:43 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [auto1.nl] INFO: Scrape type for BN23461: 1
2026-03-27 19:11:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:43 [auto1.nl] INFO: Found listing with ID: FZ65940
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ65940%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [auto1.nl] INFO: Scrape type for FZ65940: 2
2026-03-27 19:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99055c1f-37c2-577d-beed-b0e6adb395f1 with identifier: FZ65940
2026-03-27 19:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99055c1f-37c2-577d-beed-b0e6adb395f1 with scrape type 2
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99055c1f-37c2-577d-beed-b0e6adb395f1 with scrape type 2
2026-03-27 19:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99055c1f-37c2-577d-beed-b0e6adb395f1, identifier: FZ65940
2026-03-27 19:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW90615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY94157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY18740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aaa99ff-19e3-541c-ac68-be661f591c04 with identifier: DL78347
2026-03-27 19:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aaa99ff-19e3-541c-ac68-be661f591c04 with scrape type 1
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0aaa99ff-19e3-541c-ac68-be661f591c04
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Feb%252Fa8ebcad4339d320016dbbba2a7632064%252Fpa%252FDL78347_0b3ce8e3a910b6a16b74ba55ba92c338.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_0b3ce8e3a910b6a16b74ba55ba92c338.jpg already downloaded
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Feb%252Fa8ebcad4339d320016dbbba2a7632064%252Fpa%252FDL78347_e7b9d253aee58a88c676b63d64d7291e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_e7b9d253aee58a88c676b63d64d7291e.jpg already downloaded
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Feb%252Fa8ebcad4339d320016dbbba2a7632064%252Fpa%252FDL78347_fa3fc97a5fb24091c625e77ec6d15b78.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_fa3fc97a5fb24091c625e77ec6d15b78.jpg already downloaded
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Feb%252Fa8ebcad4339d320016dbbba2a7632064%252Fpa%252FDL78347_cb8036799d04184b31b460895d5126b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_cb8036799d04184b31b460895d5126b6.jpg already downloaded
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Feb%252Fa8ebcad4339d320016dbbba2a7632064%252Fpa%252FDL78347_0b7bb44caf8077456413272a5632d405.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_0b7bb44caf8077456413272a5632d405.jpg already downloaded
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Feb%252Fa8ebcad4339d320016dbbba2a7632064%252Fpa%252FDL78347_e1e66eab2e4bfb766d0e97368737a418.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_e1e66eab2e4bfb766d0e97368737a418.jpg already downloaded
2026-03-27 19:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0aaa99ff-19e3-541c-ac68-be661f591c04, identifier: DL78347
2026-03-27 19:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99055c1f-37c2-577d-beed-b0e6adb395f1 with identifier: FZ65940
2026-03-27 19:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99055c1f-37c2-577d-beed-b0e6adb395f1 with identifier: FZ65940
2026-03-27 19:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99055c1f-37c2-577d-beed-b0e6adb395f1 with identifier: FZ65940 to the API
2026-03-27 19:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:33:46Z',
 'fuel_type': 'petrol',
 'id': '99055c1f-37c2-577d-beed-b0e6adb395f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ65940',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 161719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-26',
 'seller_name': None,
 'title': 'Kia Venga 1.4 Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2010}
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ65940%27 HTTP/1.1" 200 None
2026-03-27 19:11:45 [auto1.nl] INFO: Saving data for FZ65940: {'auction_closing_time': 1774715626.0, 'created_time': 1773135303.874182, 'last_price_update_time': 1774638705.422559}
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FZ65940') HTTP/1.1" 204 0
2026-03-27 19:11:45 [auto1.nl] INFO: Found listing with ID: DV95890
2026-03-27 19:11:45 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-27 19:11:45 [auto1.nl] INFO: Scrape type for DB11708: 1
2026-03-27 19:11:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0aaa99ff-19e3-541c-ac68-be661f591c04 with identifier: DL78347
2026-03-27 19:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0aaa99ff-19e3-541c-ac68-be661f591c04 with identifier: DL78347
2026-03-27 19:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0aaa99ff-19e3-541c-ac68-be661f591c04 with identifier: DL78347 to the API
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DL78347>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:48:35Z',
 'fuel_type': 'petrol',
 'id': '0aaa99ff-19e3-541c-ac68-be661f591c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '96-RV-RF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL78347',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 247398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_0b3ce8e3a910b6a16b74ba55ba92c338.jpg',
                'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_e7b9d253aee58a88c676b63d64d7291e.jpg',
                'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_fa3fc97a5fb24091c625e77ec6d15b78.jpg',
                'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_cb8036799d04184b31b460895d5126b6.jpg',
                'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_0b7bb44caf8077456413272a5632d405.jpg',
                'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_e1e66eab2e4bfb766d0e97368737a418.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aaa99ff-19e3-541c-ac68-be661f591c04/0aaa99ff-19e3-541c-ac68-be661f591c04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_0b3ce8e3a910b6a16b74ba55ba92c338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aaa99ff-19e3-541c-ac68-be661f591c04/0aaa99ff-19e3-541c-ac68-be661f591c04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_e7b9d253aee58a88c676b63d64d7291e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aaa99ff-19e3-541c-ac68-be661f591c04/0aaa99ff-19e3-541c-ac68-be661f591c04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_fa3fc97a5fb24091c625e77ec6d15b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aaa99ff-19e3-541c-ac68-be661f591c04/0aaa99ff-19e3-541c-ac68-be661f591c04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_cb8036799d04184b31b460895d5126b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aaa99ff-19e3-541c-ac68-be661f591c04/0aaa99ff-19e3-541c-ac68-be661f591c04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_0b7bb44caf8077456413272a5632d405.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aaa99ff-19e3-541c-ac68-be661f591c04/0aaa99ff-19e3-541c-ac68-be661f591c04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/eb/a8ebcad4339d320016dbbba2a7632064/pa/DL78347_e1e66eab2e4bfb766d0e97368737a418.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL78347%27 HTTP/1.1" 200 None
2026-03-27 19:11:45 [auto1.nl] INFO: Saving data for DL78347: {'created_time': 1774638705.857568, 'last_price_update_time': 1774638705.857578, 'auction_closing_time': 1774716515.0}
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DL78347') HTTP/1.1" 204 0
2026-03-27 19:11:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_f2143d98401ab156c283deef01acae6b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:45 [auto1.nl] INFO: Found listing with ID: TL21960
2026-03-27 19:11:45 [auto1.nl] INFO: Found listing with ID: GJ92310
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ92310%27 HTTP/1.1" 200 None
2026-03-27 19:11:45 [auto1.nl] INFO: Scrape type for GJ92310: 2
2026-03-27 19:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a14b9b7-42b1-5a4c-84bf-763af3dddcdc with identifier: GJ92310
2026-03-27 19:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a14b9b7-42b1-5a4c-84bf-763af3dddcdc with scrape type 2
2026-03-27 19:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a14b9b7-42b1-5a4c-84bf-763af3dddcdc with scrape type 2
2026-03-27 19:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5a14b9b7-42b1-5a4c-84bf-763af3dddcdc, identifier: GJ92310
2026-03-27 19:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5a14b9b7-42b1-5a4c-84bf-763af3dddcdc with identifier: GJ92310
2026-03-27 19:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5a14b9b7-42b1-5a4c-84bf-763af3dddcdc with identifier: GJ92310
2026-03-27 19:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5a14b9b7-42b1-5a4c-84bf-763af3dddcdc with identifier: GJ92310 to the API
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:14Z',
 'fuel_type': 'petrol',
 'id': '5a14b9b7-42b1-5a4c-84bf-763af3dddcdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ92310',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 205414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-11',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ92310%27 HTTP/1.1" 200 None
2026-03-27 19:11:46 [auto1.nl] INFO: Saving data for GJ92310: {'auction_closing_time': 1774716854.0, 'created_time': 1773132158.119591, 'last_price_update_time': 1774638706.407202}
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GJ92310') HTTP/1.1" 204 0
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: FG40185
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: GZ83628
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: NA39376
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA39376%27 HTTP/1.1" 200 None
2026-03-27 19:11:46 [auto1.nl] INFO: Scrape type for NA39376: 1
2026-03-27 19:11:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: MV90025
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: UG47676
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: AE22840
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: WU52252
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-27 19:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP41268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:46 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-27 19:11:46 [auto1.nl] INFO: Scrape type for AR80776: 1
2026-03-27 19:11:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29ef1d0>
2026-03-27 19:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Feb%252F82eb01e1426a69c90777fad35368bce7%252Fpa%252FAX28541_f2143d98401ab156c283deef01acae6b.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_f2143d98401ab156c283deef01acae6b.jpg saved to cache
2026-03-27 19:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77
2026-03-27 19:11:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b6cc668-c3aa-5cb6-b872-48300bbcae77, skipping ID generation
2026-03-27 19:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with scrape type 1
2026-03-27 19:11:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77 sending to next pipeline
2026-03-27 19:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b6cc668-c3aa-5cb6-b872-48300bbcae77, identifier: AX28541
2026-03-27 19:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with identifier: AX28541
2026-03-27 19:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with identifier: AX28541
2026-03-27 19:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with identifier: AX28541 to the API
2026-03-27 19:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_f2143d98401ab156c283deef01acae6b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:54:32Z',
 'fuel_type': 'petrol',
 'id': '5b6cc668-c3aa-5cb6-b872-48300bbcae77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'X723RX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX28541',
 'listing': 'auction',
 'location': 'NL, Raamsdonksveer',
 'make': 'BMW',
 'model': '1er',
 'odometer': 143379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_dd8d6377a29a98e127a8f3c683f37b46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_948e6534077bed5228857d322277731b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_424bb00105b34b3e32ac90c828129b31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_cee4a2bbd536be956002635519430fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_3302d3cc96cff5ddf202ce4a88bc7ed8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_11cf8c25e4209205d4fd9ab9961aa0d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_d5b0d591b6d6b760274030985fcc7228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_0e0c4545658299e228840f832f01e1eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 886674,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_f2143d98401ab156c283deef01acae6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6cc668-c3aa-5cb6-b872-48300bbcae77/5b6cc668-c3aa-5cb6-b872-48300bbcae77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/eb/82eb01e1426a69c90777fad35368bce7/pa/AX28541_0e86cb0a84a574d927f685f7cb28d3f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2016}
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-27 19:11:48 [auto1.nl] INFO: Saving data for AX28541: {'created_time': 1774638708.273164, 'last_price_update_time': 1774638708.273173, 'auction_closing_time': 1774716872.0}
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX28541') HTTP/1.1" 204 0
2026-03-27 19:11:48 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-27 19:11:48 [auto1.nl] INFO: Scrape type for PY93062: 1
2026-03-27 19:11:48 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-27 19:11:48 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-27 19:11:48 [auto1.nl] INFO: Scrape type for DD48612: 2
2026-03-27 19:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98af560-be81-5282-aa67-608f4b1bef6b with identifier: DD48612
2026-03-27 19:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98af560-be81-5282-aa67-608f4b1bef6b with scrape type 2
2026-03-27 19:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98af560-be81-5282-aa67-608f4b1bef6b with scrape type 2
2026-03-27 19:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b98af560-be81-5282-aa67-608f4b1bef6b, identifier: DD48612
2026-03-27 19:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW61305> (referer: https://www.auto1.com/v1/car-details-view/AW61305/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b98af560-be81-5282-aa67-608f4b1bef6b with identifier: DD48612
2026-03-27 19:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b98af560-be81-5282-aa67-608f4b1bef6b with identifier: DD48612
2026-03-27 19:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b98af560-be81-5282-aa67-608f4b1bef6b with identifier: DD48612 to the API
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:53:22Z',
 'fuel_type': 'hybrid',
 'id': 'b98af560-be81-5282-aa67-608f4b1bef6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD48612',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 75683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-11',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T8 Plug-in Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2020}
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-27 19:11:48 [auto1.nl] INFO: Saving data for DD48612: {'auction_closing_time': 1774716802.0, 'created_time': 1773927867.357678, 'last_price_update_time': 1774638708.917783}
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DD48612') HTTP/1.1" 204 0
2026-03-27 19:11:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:48 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-27 19:11:48 [auto1.nl] INFO: Scrape type for CM00428: 1
2026-03-27 19:11:48 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-27 19:11:48 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-27 19:11:48 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-27 19:11:48 [auto1.nl] INFO: Scrape type for TW55830: 1
2026-03-27 19:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-27 19:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30e26517-6d5d-5863-823e-b00c4ac6e534 with scrape type 1
2026-03-27 19:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 30e26517-6d5d-5863-823e-b00c4ac6e534
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcf%252F32cf472959c5435d273758e32e11480f%252Fpa%252FAW61305_d94c5d723d8c1946532e98750da43d46.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_d94c5d723d8c1946532e98750da43d46.jpg already downloaded
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcf%252F32cf472959c5435d273758e32e11480f%252Fpa%252FAW61305_8ad4e2d6f8574151098d5c6daceaf299.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_8ad4e2d6f8574151098d5c6daceaf299.jpg already downloaded
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcf%252F32cf472959c5435d273758e32e11480f%252Fpa%252FAW61305_0501a52e706700e208be2e89064e5019.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_0501a52e706700e208be2e89064e5019.jpg already downloaded
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcf%252F32cf472959c5435d273758e32e11480f%252Fpa%252FAW61305_b33963a95c8a80b8229ae3381f27f1f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_b33963a95c8a80b8229ae3381f27f1f3.jpg already downloaded
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcf%252F32cf472959c5435d273758e32e11480f%252Fpa%252FAW61305_bff3af66d1c85206d29148ce8a5dd031.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_bff3af66d1c85206d29148ce8a5dd031.jpg already downloaded
2026-03-27 19:11:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 30e26517-6d5d-5863-823e-b00c4ac6e534, identifier: AW61305
2026-03-27 19:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-27 19:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-27 19:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305 to the API
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW61305>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:55:15Z',
 'fuel_type': 'petrol',
 'id': '30e26517-6d5d-5863-823e-b00c4ac6e534',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '74TLJZ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW61305',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 159970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_d94c5d723d8c1946532e98750da43d46.jpg',
                'https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_8ad4e2d6f8574151098d5c6daceaf299.jpg',
                'https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_0501a52e706700e208be2e89064e5019.jpg',
                'https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_b33963a95c8a80b8229ae3381f27f1f3.jpg',
                'https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_bff3af66d1c85206d29148ce8a5dd031.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30e26517-6d5d-5863-823e-b00c4ac6e534/30e26517-6d5d-5863-823e-b00c4ac6e534_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_d94c5d723d8c1946532e98750da43d46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30e26517-6d5d-5863-823e-b00c4ac6e534/30e26517-6d5d-5863-823e-b00c4ac6e534_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_8ad4e2d6f8574151098d5c6daceaf299.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30e26517-6d5d-5863-823e-b00c4ac6e534/30e26517-6d5d-5863-823e-b00c4ac6e534_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_0501a52e706700e208be2e89064e5019.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30e26517-6d5d-5863-823e-b00c4ac6e534/30e26517-6d5d-5863-823e-b00c4ac6e534_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_b33963a95c8a80b8229ae3381f27f1f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30e26517-6d5d-5863-823e-b00c4ac6e534/30e26517-6d5d-5863-823e-b00c4ac6e534_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cf/32cf472959c5435d273758e32e11480f/pa/AW61305_bff3af66d1c85206d29148ce8a5dd031.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 2.0 Exception',
 'transmission': 'manual',
 'trim': 'Exception',
 'year': 2006}
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Saving data for AW61305: {'created_time': 1774638709.611317, 'last_price_update_time': 1774638709.611325, 'auction_closing_time': 1774716915.0}
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW61305') HTTP/1.1" 204 0
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: HH59991
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59991%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for HH59991: 1
2026-03-27 19:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY18740> (referer: https://www.auto1.com/v1/car-details-view/UY18740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for FW39949: 1
2026-03-27 19:11:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM31499> (referer: https://www.auto1.com/v1/car-details-view/EM31499/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN23461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB31523/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for UR99157: 1
2026-03-27 19:11:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for AM07460: 1
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for MZ50492: 1
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: JY58487
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY58487%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for JY58487: 1
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: NG63197
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for NP69601: 1
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for HC58225: 1
2026-03-27 19:11:49 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 916 | hits on page: 40
2026-03-27 19:11:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8cc57e7-24d1-55b6-a939-72e59a9813d1 with identifier: UY18740
2026-03-27 19:11:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8cc57e7-24d1-55b6-a939-72e59a9813d1 with scrape type 1
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item f8cc57e7-24d1-55b6-a939-72e59a9813d1
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F16%252F9c16b8eaffc4aed9b77b72633d34a739%252Fpa%252FUY18740_e94d3efa8521b3ff5ec1d30aab248180.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_e94d3efa8521b3ff5ec1d30aab248180.jpg not downloaded yet
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: UD56346
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for VU12203: 1
2026-03-27 19:11:49 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [auto1.nl] INFO: Scrape type for NR15886: 1
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F16%252F9c16b8eaffc4aed9b77b72633d34a739%252Fpa%252FUY18740_e6f8b507986e717d72c564eb16a049d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_e6f8b507986e717d72c564eb16a049d8.jpg not downloaded yet
2026-03-27 19:11:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0131c76-6323-5c0d-a478-726dcee517d7 with identifier: EM31499
2026-03-27 19:11:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0131c76-6323-5c0d-a478-726dcee517d7 with scrape type 1
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0131c76-6323-5c0d-a478-726dcee517d7
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_84563744ae065ba4c00342d2aad25bb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_84563744ae065ba4c00342d2aad25bb8.jpg already downloaded
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_d2e8885b61ada09c86dfa2b89a68b3e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_d2e8885b61ada09c86dfa2b89a68b3e6.jpg already downloaded
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_dde893fbf7bbf46ccceb665486acf26e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_dde893fbf7bbf46ccceb665486acf26e.jpg already downloaded
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_6c5a4fa15e2b7957bfaf37f5330192cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_6c5a4fa15e2b7957bfaf37f5330192cd.jpg already downloaded
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_f952dcedd08d7536e2a47feb8bd253b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_f952dcedd08d7536e2a47feb8bd253b9.jpg already downloaded
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_b8ad4dba1ee930e3591d28d5de80075a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_b8ad4dba1ee930e3591d28d5de80075a.jpg already downloaded
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_403196287f558a78a701ffec4aab4893.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_403196287f558a78a701ffec4aab4893.jpg already downloaded
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_0e4b7e955c098df3996fa6e5cbb49531.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_0e4b7e955c098df3996fa6e5cbb49531.jpg already downloaded
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_a602ce1c6388c6466b55460e260be296.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_a602ce1c6388c6466b55460e260be296.jpg already downloaded
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1b%252F381b2615f250d0fc64d96a219a821320%252Fpa%252FEM31499_f110a2f7f5cbbba14377e4773593e634.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_f110a2f7f5cbbba14377e4773593e634.jpg already downloaded
2026-03-27 19:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f0131c76-6323-5c0d-a478-726dcee517d7, identifier: EM31499
2026-03-27 19:11:50 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-27 19:11:50 [auto1.nl] INFO: Scrape type for YR49127: 1
2026-03-27 19:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f0131c76-6323-5c0d-a478-726dcee517d7 with identifier: EM31499
2026-03-27 19:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f0131c76-6323-5c0d-a478-726dcee517d7 with identifier: EM31499
2026-03-27 19:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f0131c76-6323-5c0d-a478-726dcee517d7 with identifier: EM31499 to the API
2026-03-27 19:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM31499>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:54:42Z',
 'fuel_type': 'petrol',
 'id': 'f0131c76-6323-5c0d-a478-726dcee517d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '96LTFP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM31499',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 136264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_84563744ae065ba4c00342d2aad25bb8.jpg',
                'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_d2e8885b61ada09c86dfa2b89a68b3e6.jpg',
                'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_dde893fbf7bbf46ccceb665486acf26e.jpg',
                'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_6c5a4fa15e2b7957bfaf37f5330192cd.jpg',
                'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_f952dcedd08d7536e2a47feb8bd253b9.jpg',
                'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_b8ad4dba1ee930e3591d28d5de80075a.jpg',
                'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_403196287f558a78a701ffec4aab4893.jpg',
                'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_0e4b7e955c098df3996fa6e5cbb49531.jpg',
                'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_a602ce1c6388c6466b55460e260be296.jpg',
                'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_f110a2f7f5cbbba14377e4773593e634.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_84563744ae065ba4c00342d2aad25bb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_d2e8885b61ada09c86dfa2b89a68b3e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_dde893fbf7bbf46ccceb665486acf26e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_6c5a4fa15e2b7957bfaf37f5330192cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_f952dcedd08d7536e2a47feb8bd253b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_b8ad4dba1ee930e3591d28d5de80075a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_403196287f558a78a701ffec4aab4893.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_0e4b7e955c098df3996fa6e5cbb49531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_a602ce1c6388c6466b55460e260be296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0131c76-6323-5c0d-a478-726dcee517d7/f0131c76-6323-5c0d-a478-726dcee517d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1b/381b2615f250d0fc64d96a219a821320/pa/EM31499_f110a2f7f5cbbba14377e4773593e634.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Freelander 1.8 Station Wagon E',
 'transmission': 'manual',
 'trim': 'Station Wagon E',
 'year': 2003}
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM31499%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [auto1.nl] INFO: Saving data for EM31499: {'created_time': 1774638711.127035, 'last_price_update_time': 1774638711.127045, 'auction_closing_time': 1774716882.0}
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM31499') HTTP/1.1" 204 0
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [auto1.nl] INFO: Scrape type for WN75862: 2
2026-03-27 19:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db64347a-75d8-592c-a938-c71ad0fa23ef with identifier: WN75862
2026-03-27 19:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db64347a-75d8-592c-a938-c71ad0fa23ef with scrape type 2
2026-03-27 19:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db64347a-75d8-592c-a938-c71ad0fa23ef with scrape type 2
2026-03-27 19:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: db64347a-75d8-592c-a938-c71ad0fa23ef, identifier: WN75862
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F16%252F9c16b8eaffc4aed9b77b72633d34a739%252Fpa%252FUY18740_b91ee39f1b2eb8baeda5f0820a6054a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_b91ee39f1b2eb8baeda5f0820a6054a0.jpg not downloaded yet
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [auto1.nl] INFO: Scrape type for FL63517: 1
2026-03-27 19:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: db64347a-75d8-592c-a938-c71ad0fa23ef with identifier: WN75862
2026-03-27 19:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: db64347a-75d8-592c-a938-c71ad0fa23ef with identifier: WN75862
2026-03-27 19:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: db64347a-75d8-592c-a938-c71ad0fa23ef with identifier: WN75862 to the API
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:56:20Z',
 'fuel_type': 'petrol',
 'id': 'db64347a-75d8-592c-a938-c71ad0fa23ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN75862',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 184131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [auto1.nl] INFO: Saving data for WN75862: {'auction_closing_time': 1774716980.0, 'created_time': 1773836978.064791, 'last_price_update_time': 1774638711.697033}
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN75862') HTTP/1.1" 204 0
2026-03-27 19:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY94157> (referer: https://www.auto1.com/v1/car-details-view/BY94157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [auto1.nl] INFO: Scrape type for PN82428: 1
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F16%252F9c16b8eaffc4aed9b77b72633d34a739%252Fpa%252FUY18740_78a16dc20a7f1b215c07a4e9604fa80c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_78a16dc20a7f1b215c07a4e9604fa80c.jpg not downloaded yet
2026-03-27 19:11:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: HH96879
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [auto1.nl] INFO: Scrape type for HD17412: 1
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [auto1.nl] INFO: Scrape type for EH64896: 1
2026-03-27 19:11:51 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-27 19:11:51 [auto1.nl] INFO: Scrape type for AC84495: 2
2026-03-27 19:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9544290a-081f-59bd-b674-d583af77271f with identifier: AC84495
2026-03-27 19:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9544290a-081f-59bd-b674-d583af77271f with scrape type 2
2026-03-27 19:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9544290a-081f-59bd-b674-d583af77271f with scrape type 2
2026-03-27 19:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9544290a-081f-59bd-b674-d583af77271f, identifier: AC84495
2026-03-27 19:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9544290a-081f-59bd-b674-d583af77271f with identifier: AC84495
2026-03-27 19:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9544290a-081f-59bd-b674-d583af77271f with identifier: AC84495
2026-03-27 19:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9544290a-081f-59bd-b674-d583af77271f with identifier: AC84495 to the API
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:45:04Z',
 'fuel_type': 'petrol',
 'id': '9544290a-081f-59bd-b674-d583af77271f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC84495',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 146009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-22',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Attract",
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2014}
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [auto1.nl] INFO: Saving data for AC84495: {'auction_closing_time': 1774716304.0, 'created_time': 1773775016.690612, 'last_price_update_time': 1774638712.288807}
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AC84495') HTTP/1.1" 204 0
2026-03-27 19:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_b91ee39f1b2eb8baeda5f0820a6054a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [auto1.nl] INFO: Scrape type for KD36085: 1
2026-03-27 19:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with identifier: BY94157
2026-03-27 19:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with scrape type 1
2026-03-27 19:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_81f19e122dbd5242d5e45929d0c8b2e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_81f19e122dbd5242d5e45929d0c8b2e1.jpg not downloaded yet
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [auto1.nl] INFO: Scrape type for WP95967: 1
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_6c900ba400e8c7d644f8a5729083aae3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_6c900ba400e8c7d644f8a5729083aae3.jpg not downloaded yet
2026-03-27 19:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA39376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [auto1.nl] INFO: Scrape type for UJ05110: 1
2026-03-27 19:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_a013ab09e0ad60339bdee1f58593add0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_a013ab09e0ad60339bdee1f58593add0.jpg not downloaded yet
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [auto1.nl] INFO: Scrape type for GN89359: 1
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_fbe0e60d1bedbcb97f986ae9b5ec439a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_fbe0e60d1bedbcb97f986ae9b5ec439a.jpg not downloaded yet
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [auto1.nl] INFO: Scrape type for EL29526: 1
2026-03-27 19:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b21d0>
2026-03-27 19:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cc57e7-24d1-55b6-a939-72e59a9813d1/f8cc57e7-24d1-55b6-a939-72e59a9813d1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F16%252F9c16b8eaffc4aed9b77b72633d34a739%252Fpa%252FUY18740_b91ee39f1b2eb8baeda5f0820a6054a0.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_b91ee39f1b2eb8baeda5f0820a6054a0.jpg saved to cache
2026-03-27 19:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8cc57e7-24d1-55b6-a939-72e59a9813d1
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_f5a912353e3f98a7e4670a35d760f650.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_f5a912353e3f98a7e4670a35d760f650.jpg not downloaded yet
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: NY79842
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: LR65933
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR65933%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [auto1.nl] INFO: Scrape type for LR65933: 1
2026-03-27 19:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_6c900ba400e8c7d644f8a5729083aae3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL89699> (referer: https://www.auto1.com/v1/car-details-view/HL89699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR80776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-27 19:11:52 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-27 19:11:52 [auto1.nl] INFO: Scrape type for WE00434: 2
2026-03-27 19:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a55519ca-1349-5fe6-8c0c-0f9c15a573bd with identifier: WE00434
2026-03-27 19:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a55519ca-1349-5fe6-8c0c-0f9c15a573bd with scrape type 2
2026-03-27 19:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a55519ca-1349-5fe6-8c0c-0f9c15a573bd with scrape type 2
2026-03-27 19:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a55519ca-1349-5fe6-8c0c-0f9c15a573bd, identifier: WE00434
2026-03-27 19:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a55519ca-1349-5fe6-8c0c-0f9c15a573bd with identifier: WE00434
2026-03-27 19:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a55519ca-1349-5fe6-8c0c-0f9c15a573bd with identifier: WE00434
2026-03-27 19:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a55519ca-1349-5fe6-8c0c-0f9c15a573bd with identifier: WE00434 to the API
2026-03-27 19:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:04:51Z',
 'fuel_type': 'petrol',
 'id': 'a55519ca-1349-5fe6-8c0c-0f9c15a573bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE00434',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 100942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-27 19:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-27 19:11:53 [auto1.nl] INFO: Saving data for WE00434: {'auction_closing_time': 1774713891.0, 'created_time': 1773924412.726741, 'last_price_update_time': 1774638713.958156}
2026-03-27 19:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WE00434') HTTP/1.1" 204 0
2026-03-27 19:11:54 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-27 19:11:54 [auto1.nl] INFO: Scrape type for SZ87293: 1
2026-03-27 19:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV84229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY93062/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW90615> (referer: https://www.auto1.com/v1/car-details-view/XW90615/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_f5a912353e3f98a7e4670a35d760f650.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:54 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-27 19:11:54 [auto1.nl] INFO: Scrape type for FK48987: 1
2026-03-27 19:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2940e90>
2026-03-27 19:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_6c900ba400e8c7d644f8a5729083aae3.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_6c900ba400e8c7d644f8a5729083aae3.jpg saved to cache
2026-03-27 19:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034
2026-03-27 19:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a89fa08-1f66-5a03-ba92-e05181666266 with identifier: HL89699
2026-03-27 19:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a89fa08-1f66-5a03-ba92-e05181666266 with scrape type 1
2026-03-27 19:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_93590263da207123a490a28f45d61e0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_93590263da207123a490a28f45d61e0d.jpg not downloaded yet
2026-03-27 19:11:54 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-27 19:11:54 [auto1.nl] INFO: Scrape type for NX76865: 1
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_f04d160a7faa055578c54688e4f07c2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_f04d160a7faa055578c54688e4f07c2e.jpg not downloaded yet
2026-03-27 19:11:54 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-27 19:11:54 [auto1.nl] INFO: Scrape type for SM08260: 2
2026-03-27 19:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca03c431-34cd-5d01-b909-594d9ae88a9d with identifier: SM08260
2026-03-27 19:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca03c431-34cd-5d01-b909-594d9ae88a9d with scrape type 2
2026-03-27 19:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca03c431-34cd-5d01-b909-594d9ae88a9d with scrape type 2
2026-03-27 19:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca03c431-34cd-5d01-b909-594d9ae88a9d, identifier: SM08260
2026-03-27 19:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca03c431-34cd-5d01-b909-594d9ae88a9d with identifier: SM08260
2026-03-27 19:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca03c431-34cd-5d01-b909-594d9ae88a9d with identifier: SM08260
2026-03-27 19:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca03c431-34cd-5d01-b909-594d9ae88a9d with identifier: SM08260 to the API
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:05:57Z',
 'fuel_type': 'diesel',
 'id': 'ca03c431-34cd-5d01-b909-594d9ae88a9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM08260',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 225698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2014}
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-27 19:11:54 [auto1.nl] INFO: Saving data for SM08260: {'auction_closing_time': 1774713957.0, 'created_time': 1774354363.028852, 'last_price_update_time': 1774638714.934113}
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SM08260') HTTP/1.1" 204 0
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_99beaf5b4c9b14841770a85044586d26.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_99beaf5b4c9b14841770a85044586d26.jpg not downloaded yet
2026-03-27 19:11:54 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-27 19:11:54 [auto1.nl] INFO: Found listing with ID: TJ92302
2026-03-27 19:11:54 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-27 19:11:54 [auto1.nl] INFO: Scrape type for GN05115: 1
2026-03-27 19:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615
2026-03-27 19:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99928119-baaf-5c23-95e8-0856a6b17c54 with scrape type 1
2026-03-27 19:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_79a52d6977f3eb82f7e50ceacaf12ff4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_79a52d6977f3eb82f7e50ceacaf12ff4.jpg not downloaded yet
2026-03-27 19:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae329ca90>
2026-03-27 19:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_f5a912353e3f98a7e4670a35d760f650.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_f5a912353e3f98a7e4670a35d760f650.jpg saved to cache
2026-03-27 19:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034
2026-03-27 19:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_fbe0e60d1bedbcb97f986ae9b5ec439a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_53c1305d057aedd764889d7d50a0c98f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_53c1305d057aedd764889d7d50a0c98f.jpg not downloaded yet
2026-03-27 19:11:55 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-27 19:11:55 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-27 19:11:55 [auto1.nl] INFO: Scrape type for RY75066: 1
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_34040960132d0aa6c0c7f18a19b96bdf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_34040960132d0aa6c0c7f18a19b96bdf.jpg not downloaded yet
2026-03-27 19:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM00428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_cfbcbb72b31c02162172f89e12e87d5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_cfbcbb72b31c02162172f89e12e87d5c.jpg not downloaded yet
2026-03-27 19:11:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:55 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-27 19:11:55 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-27 19:11:55 [auto1.nl] INFO: Scrape type for AZ42388: 2
2026-03-27 19:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19447c5-2ff9-5c76-a231-e99044922abe with identifier: AZ42388
2026-03-27 19:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19447c5-2ff9-5c76-a231-e99044922abe with scrape type 2
2026-03-27 19:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19447c5-2ff9-5c76-a231-e99044922abe with scrape type 2
2026-03-27 19:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b19447c5-2ff9-5c76-a231-e99044922abe, identifier: AZ42388
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_dabee727157c10a20f9d1d00b2a688bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_dabee727157c10a20f9d1d00b2a688bf.jpg not downloaded yet
2026-03-27 19:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b19447c5-2ff9-5c76-a231-e99044922abe with identifier: AZ42388
2026-03-27 19:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b19447c5-2ff9-5c76-a231-e99044922abe with identifier: AZ42388
2026-03-27 19:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b19447c5-2ff9-5c76-a231-e99044922abe with identifier: AZ42388 to the API
2026-03-27 19:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:46Z',
 'fuel_type': 'petrol',
 'id': 'b19447c5-2ff9-5c76-a231-e99044922abe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ42388',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 52485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-12',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-27 19:11:56 [auto1.nl] INFO: Saving data for AZ42388: {'auction_closing_time': 1774715266.0, 'created_time': 1773925672.010005, 'last_price_update_time': 1774638716.648364}
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AZ42388') HTTP/1.1" 204 0
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_08dbaac1ef68715c85df092aaf6d3601.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_08dbaac1ef68715c85df092aaf6d3601.jpg not downloaded yet
2026-03-27 19:11:56 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-27 19:11:56 [auto1.nl] INFO: Scrape type for ZP12059: 1
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_8a0a894580586e8be3471dac58e2c782.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_8a0a894580586e8be3471dac58e2c782.jpg not downloaded yet
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_b42b7459216a4eb8bbb44026de715fc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_b42b7459216a4eb8bbb44026de715fc6.jpg not downloaded yet
2026-03-27 19:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae333fe90>
2026-03-27 19:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_fbe0e60d1bedbcb97f986ae9b5ec439a.jpg') HTTP/1.1" 204 0
2026-03-27 19:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_fbe0e60d1bedbcb97f986ae9b5ec439a.jpg saved to cache
2026-03-27 19:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034
2026-03-27 19:11:56 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-27 19:11:56 [auto1.nl] INFO: Scrape type for EY58020: 1
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_f923ac8da21b25dc339fbc9a45ac8c1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_f923ac8da21b25dc339fbc9a45ac8c1d.jpg not downloaded yet
2026-03-27 19:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY92282> (referer: https://www.auto1.com/v1/car-details-view/SY92282/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH59991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP41268> (referer: https://www.auto1.com/v1/car-details-view/AP41268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_7867c8c97317d9ef8c2166fdd309e369.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_7867c8c97317d9ef8c2166fdd309e369.jpg not downloaded yet
2026-03-27 19:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:11:56 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-27 19:11:56 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-27 19:11:56 [auto1.nl] INFO: Scrape type for SA79399: 2
2026-03-27 19:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399
2026-03-27 19:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10916b17-6fe9-5b28-be65-3bd62aad6713 with scrape type 2
2026-03-27 19:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10916b17-6fe9-5b28-be65-3bd62aad6713 with scrape type 2
2026-03-27 19:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 10916b17-6fe9-5b28-be65-3bd62aad6713, identifier: SA79399
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_18438bcf2d44161f00abe14954d0b580.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_18438bcf2d44161f00abe14954d0b580.jpg not downloaded yet
2026-03-27 19:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399
2026-03-27 19:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399
2026-03-27 19:11:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399 to the API
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:58:31Z',
 'fuel_type': 'diesel',
 'id': '10916b17-6fe9-5b28-be65-3bd62aad6713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA79399',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 472851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-21',
 'seller_name': None,
 'title': 'Volvo V70 2.4 D Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2008}
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [auto1.nl] INFO: Saving data for SA79399: {'auction_closing_time': 1774717111.0, 'created_time': 1773131915.949564, 'last_price_update_time': 1774638717.47001}
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA79399') HTTP/1.1" 204 0
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_21f139d72c55b89e02334447accbae0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_21f139d72c55b89e02334447accbae0d.jpg not downloaded yet
2026-03-27 19:11:57 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_917045c1e6e1962a85064493ee98f9b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_917045c1e6e1962a85064493ee98f9b1.jpg not downloaded yet
2026-03-27 19:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_8a0a894580586e8be3471dac58e2c782.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_fcf9a0fb40631b90863b1f04e9f36d45.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_fcf9a0fb40631b90863b1f04e9f36d45.jpg not downloaded yet
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_761c560d533a8a6889b8c0efec555450.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_761c560d533a8a6889b8c0efec555450.jpg not downloaded yet
2026-03-27 19:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8cdb93-fe67-5c95-88ac-6018a577b961 with identifier: SY92282
2026-03-27 19:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8cdb93-fe67-5c95-88ac-6018a577b961 with scrape type 1
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1a8cdb93-fe67-5c95-88ac-6018a577b961
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F03%252F36036586a40550b4e177f7aac63dde69%252Fpa%252FSY92282_41839a38ab4d14e30250375c536b4da9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_41839a38ab4d14e30250375c536b4da9.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F03%252F36036586a40550b4e177f7aac63dde69%252Fpa%252FSY92282_fa8143257c94147e0aebef1a4012487b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_fa8143257c94147e0aebef1a4012487b.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F03%252F36036586a40550b4e177f7aac63dde69%252Fpa%252FSY92282_ea1c2896cca0b2c42db9abad167b612a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_ea1c2896cca0b2c42db9abad167b612a.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F03%252F36036586a40550b4e177f7aac63dde69%252Fpa%252FSY92282_51f609496b3e245653df519c5b903d58.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_51f609496b3e245653df519c5b903d58.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F03%252F36036586a40550b4e177f7aac63dde69%252Fpa%252FSY92282_c45fb211ba22ac86b3d14272b500b4ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_c45fb211ba22ac86b3d14272b500b4ca.jpg already downloaded
2026-03-27 19:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a8cdb93-fe67-5c95-88ac-6018a577b961, identifier: SY92282
2026-03-27 19:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b82b257c-c641-5bdd-b588-e459003ca5f5 with identifier: AP41268
2026-03-27 19:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82b257c-c641-5bdd-b588-e459003ca5f5 with scrape type 1
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b82b257c-c641-5bdd-b588-e459003ca5f5
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_f0f5d9bb5f85a3bcc9f2d0b85a601e24.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_f0f5d9bb5f85a3bcc9f2d0b85a601e24.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_89bdb8bc09aa01c93091032663c12559.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_89bdb8bc09aa01c93091032663c12559.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_bc80516cb9e8947cc9e20f9b43083063.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_bc80516cb9e8947cc9e20f9b43083063.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_144a6a238ad24c5c16e32732b801da83.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_144a6a238ad24c5c16e32732b801da83.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_15195578fcbd5e404c30631d7ed1f11b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_15195578fcbd5e404c30631d7ed1f11b.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_85ef8f472036f6a4a321faf532a867d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_85ef8f472036f6a4a321faf532a867d6.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_d0dcb5a928a34e60ac95fa7570140ab8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_d0dcb5a928a34e60ac95fa7570140ab8.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_ed9395f8ff075978b63eb198411431eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_ed9395f8ff075978b63eb198411431eb.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_2356cfcf4bab47a32e4ac3592c802774.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_2356cfcf4bab47a32e4ac3592c802774.jpg already downloaded
2026-03-27 19:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fd5%252F52d5ada1298264efb7cbb2f79151fdb9%252Fpa%252FAP41268_791327c17f5e0585d3ed73e2f37910e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_791327c17f5e0585d3ed73e2f37910e3.jpg already downloaded
2026-03-27 19:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b82b257c-c641-5bdd-b588-e459003ca5f5, identifier: AP41268
2026-03-27 19:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a8cdb93-fe67-5c95-88ac-6018a577b961 with identifier: SY92282
2026-03-27 19:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a8cdb93-fe67-5c95-88ac-6018a577b961 with identifier: SY92282
2026-03-27 19:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a8cdb93-fe67-5c95-88ac-6018a577b961 with identifier: SY92282 to the API
2026-03-27 19:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SY92282>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': 'Taxi',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:54:47Z',
 'fuel_type': 'petrol',
 'id': '1a8cdb93-fe67-5c95-88ac-6018a577b961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '92ZKB9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY92282',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 183866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_41839a38ab4d14e30250375c536b4da9.jpg',
                'https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_fa8143257c94147e0aebef1a4012487b.jpg',
                'https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_ea1c2896cca0b2c42db9abad167b612a.jpg',
                'https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_51f609496b3e245653df519c5b903d58.jpg',
                'https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_c45fb211ba22ac86b3d14272b500b4ca.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8cdb93-fe67-5c95-88ac-6018a577b961/1a8cdb93-fe67-5c95-88ac-6018a577b961_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_41839a38ab4d14e30250375c536b4da9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8cdb93-fe67-5c95-88ac-6018a577b961/1a8cdb93-fe67-5c95-88ac-6018a577b961_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_fa8143257c94147e0aebef1a4012487b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8cdb93-fe67-5c95-88ac-6018a577b961/1a8cdb93-fe67-5c95-88ac-6018a577b961_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_ea1c2896cca0b2c42db9abad167b612a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8cdb93-fe67-5c95-88ac-6018a577b961/1a8cdb93-fe67-5c95-88ac-6018a577b961_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_51f609496b3e245653df519c5b903d58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8cdb93-fe67-5c95-88ac-6018a577b961/1a8cdb93-fe67-5c95-88ac-6018a577b961_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/03/36036586a40550b4e177f7aac63dde69/pa/SY92282_c45fb211ba22ac86b3d14272b500b4ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2012}
2026-03-27 19:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-27 19:12:00 [auto1.nl] INFO: Saving data for SY92282: {'created_time': 1774638720.348761, 'last_price_update_time': 1774638720.348771, 'auction_closing_time': 1774716887.0}
2026-03-27 19:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY92282') HTTP/1.1" 204 0
2026-03-27 19:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b82b257c-c641-5bdd-b588-e459003ca5f5 with identifier: AP41268
2026-03-27 19:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b82b257c-c641-5bdd-b588-e459003ca5f5 with identifier: AP41268
2026-03-27 19:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b82b257c-c641-5bdd-b588-e459003ca5f5 with identifier: AP41268 to the API
2026-03-27 19:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AP41268>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:43:47Z',
 'fuel_type': 'diesel',
 'id': 'b82b257c-c641-5bdd-b588-e459003ca5f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JL158R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP41268',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 296706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_f0f5d9bb5f85a3bcc9f2d0b85a601e24.jpg',
                'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_89bdb8bc09aa01c93091032663c12559.jpg',
                'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_bc80516cb9e8947cc9e20f9b43083063.jpg',
                'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_144a6a238ad24c5c16e32732b801da83.jpg',
                'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_15195578fcbd5e404c30631d7ed1f11b.jpg',
                'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_85ef8f472036f6a4a321faf532a867d6.jpg',
                'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_d0dcb5a928a34e60ac95fa7570140ab8.jpg',
                'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_ed9395f8ff075978b63eb198411431eb.jpg',
                'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_2356cfcf4bab47a32e4ac3592c802774.jpg',
                'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_791327c17f5e0585d3ed73e2f37910e3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_f0f5d9bb5f85a3bcc9f2d0b85a601e24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_89bdb8bc09aa01c93091032663c12559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_bc80516cb9e8947cc9e20f9b43083063.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_144a6a238ad24c5c16e32732b801da83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_15195578fcbd5e404c30631d7ed1f11b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_85ef8f472036f6a4a321faf532a867d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_d0dcb5a928a34e60ac95fa7570140ab8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_ed9395f8ff075978b63eb198411431eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_2356cfcf4bab47a32e4ac3592c802774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82b257c-c641-5bdd-b588-e459003ca5f5/b82b257c-c641-5bdd-b588-e459003ca5f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/d5/52d5ada1298264efb7cbb2f79151fdb9/pa/AP41268_791327c17f5e0585d3ed73e2f37910e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI BlueTEC Elegance',
 'transmission': 'automatic',
 'trim': 'BlueTEC Elegance',
 'year': 2011}
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AP41268%27 HTTP/1.1" 200 None
2026-03-27 19:12:02 [auto1.nl] INFO: Saving data for AP41268: {'created_time': 1774638722.053166, 'last_price_update_time': 1774638722.053176, 'auction_closing_time': 1774716227.0}
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AP41268') HTTP/1.1" 204 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_0792eacc6ff6cce59cacf190a5749ed3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_0792eacc6ff6cce59cacf190a5749ed3.jpg not downloaded yet
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR99157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW39949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM07460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW55830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_0f9da9e155fde00ba34d09eecd9fa709.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_0f9da9e155fde00ba34d09eecd9fa709.jpg not downloaded yet
2026-03-27 19:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29e6c10>
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_8a0a894580586e8be3471dac58e2c782.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_8a0a894580586e8be3471dac58e2c782.jpg saved to cache
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_53c1305d057aedd764889d7d50a0c98f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_99beaf5b4c9b14841770a85044586d26.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_b42b7459216a4eb8bbb44026de715fc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_21f139d72c55b89e02334447accbae0d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_917045c1e6e1962a85064493ee98f9b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_0f9da9e155fde00ba34d09eecd9fa709.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_761c560d533a8a6889b8c0efec555450.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_0792eacc6ff6cce59cacf190a5749ed3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2952290>
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_53c1305d057aedd764889d7d50a0c98f.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_53c1305d057aedd764889d7d50a0c98f.jpg saved to cache
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33f1850>
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_99beaf5b4c9b14841770a85044586d26.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_99beaf5b4c9b14841770a85044586d26.jpg saved to cache
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3465d10>
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_b42b7459216a4eb8bbb44026de715fc6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_b42b7459216a4eb8bbb44026de715fc6.jpg saved to cache
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2929410>
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_21f139d72c55b89e02334447accbae0d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_21f139d72c55b89e02334447accbae0d.jpg saved to cache
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2953510>
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_917045c1e6e1962a85064493ee98f9b1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_917045c1e6e1962a85064493ee98f9b1.jpg saved to cache
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2917e90>
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_0f9da9e155fde00ba34d09eecd9fa709.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_0f9da9e155fde00ba34d09eecd9fa709.jpg saved to cache
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae347a850>
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_761c560d533a8a6889b8c0efec555450.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_761c560d533a8a6889b8c0efec555450.jpg saved to cache
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9336210>
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_0792eacc6ff6cce59cacf190a5749ed3.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_0792eacc6ff6cce59cacf190a5749ed3.jpg saved to cache
2026-03-27 19:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH64896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL29526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR65933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_fcf9a0fb40631b90863b1f04e9f36d45.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_7867c8c97317d9ef8c2166fdd309e369.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_18438bcf2d44161f00abe14954d0b580.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_f923ac8da21b25dc339fbc9a45ac8c1d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34d1a10>
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_fcf9a0fb40631b90863b1f04e9f36d45.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_fcf9a0fb40631b90863b1f04e9f36d45.jpg saved to cache
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_dabee727157c10a20f9d1d00b2a688bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_34040960132d0aa6c0c7f18a19b96bdf.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3479e50>
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_7867c8c97317d9ef8c2166fdd309e369.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_7867c8c97317d9ef8c2166fdd309e369.jpg saved to cache
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33e0c50>
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_18438bcf2d44161f00abe14954d0b580.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_18438bcf2d44161f00abe14954d0b580.jpg saved to cache
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae335ae10>
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_f923ac8da21b25dc339fbc9a45ac8c1d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_f923ac8da21b25dc339fbc9a45ac8c1d.jpg saved to cache
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae332bc50>
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_dabee727157c10a20f9d1d00b2a688bf.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_dabee727157c10a20f9d1d00b2a688bf.jpg saved to cache
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32892d0>
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_34040960132d0aa6c0c7f18a19b96bdf.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_34040960132d0aa6c0c7f18a19b96bdf.jpg saved to cache
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_08dbaac1ef68715c85df092aaf6d3601.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_cfbcbb72b31c02162172f89e12e87d5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3494e10>
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_08dbaac1ef68715c85df092aaf6d3601.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_08dbaac1ef68715c85df092aaf6d3601.jpg saved to cache
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ87293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM00428> (referer: https://www.auto1.com/v1/car-details-view/CM00428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN89359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32c0e90>
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_cfbcbb72b31c02162172f89e12e87d5c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_cfbcbb72b31c02162172f89e12e87d5c.jpg saved to cache
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbaa6dcc-244c-5a8b-8537-0b65678867ce with identifier: CM00428
2026-03-27 19:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbaa6dcc-244c-5a8b-8537-0b65678867ce with scrape type 1
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_044cbca22fadf1e77a5e3de75cbbd843.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_044cbca22fadf1e77a5e3de75cbbd843.jpg not downloaded yet
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_e108b1deb12b87706b421302dbd9b27a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_e108b1deb12b87706b421302dbd9b27a.jpg not downloaded yet
2026-03-27 19:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA39376> (referer: https://www.auto1.com/v1/car-details-view/NA39376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_8b8112562a37d668921d96f69dfce3c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_8b8112562a37d668921d96f69dfce3c9.jpg not downloaded yet
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_ed53d2bd2e5d25a577d3ca88da072d39.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_ed53d2bd2e5d25a577d3ca88da072d39.jpg not downloaded yet
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_17e645f4dfff0067f77c6d3fd9656ed6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_17e645f4dfff0067f77c6d3fd9656ed6.jpg not downloaded yet
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_6640a86c7a4ef22165a4be2d3ef19869.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_6640a86c7a4ef22165a4be2d3ef19869.jpg not downloaded yet
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_e1e7f5a9c6355816f9a916141607f814.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_e1e7f5a9c6355816f9a916141607f814.jpg not downloaded yet
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_21d4d20351fb0cb8977f7218c974195c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_21d4d20351fb0cb8977f7218c974195c.jpg not downloaded yet
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_391c2d8f87006729bb03d12d688de762.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_391c2d8f87006729bb03d12d688de762.jpg not downloaded yet
2026-03-27 19:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 551244a0-76b8-5bfe-b60f-ac1146539bc4 with identifier: NA39376
2026-03-27 19:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 551244a0-76b8-5bfe-b60f-ac1146539bc4 with scrape type 1
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 551244a0-76b8-5bfe-b60f-ac1146539bc4
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_2bb6eaa11c68b7aa9780351368f0f877.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_2bb6eaa11c68b7aa9780351368f0f877.jpg not downloaded yet
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_4ba161b36ba924a449605f672c3cdb01.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_4ba161b36ba924a449605f672c3cdb01.jpg not downloaded yet
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_dcf5c6afa22792ad36bc6f8b726cf519.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_dcf5c6afa22792ad36bc6f8b726cf519.jpg not downloaded yet
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_1327bddf48f3830e6c4159e34459b946.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_1327bddf48f3830e6c4159e34459b946.jpg not downloaded yet
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_f91b37217c59cf21ffdd6d3765032dc7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_f91b37217c59cf21ffdd6d3765032dc7.jpg not downloaded yet
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_28ab928c9779a72dab09ac8602b6be76.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_28ab928c9779a72dab09ac8602b6be76.jpg not downloaded yet
2026-03-27 19:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW55830> (referer: https://www.auto1.com/v1/car-details-view/TW55830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_79a52d6977f3eb82f7e50ceacaf12ff4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_f91b37217c59cf21ffdd6d3765032dc7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_28ab928c9779a72dab09ac8602b6be76.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM07460> (referer: https://www.auto1.com/v1/car-details-view/AM07460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with identifier: TW55830
2026-03-27 19:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with scrape type 1
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_63c8c0bc35dec39d36ce35b044b4c77d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_63c8c0bc35dec39d36ce35b044b4c77d.jpg not downloaded yet
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_effcbf01c810e30d2759e8b50afd2ab9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_effcbf01c810e30d2759e8b50afd2ab9.jpg not downloaded yet
2026-03-27 19:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_1327bddf48f3830e6c4159e34459b946.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_4b6280517d2ec11ebbae918e9599979d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_4b6280517d2ec11ebbae918e9599979d.jpg not downloaded yet
2026-03-27 19:12:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 19:12:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 19:12:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 19:12:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 19:12:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 19:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae328cd50>
2026-03-27 19:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fdf%252Fb8df3bca956119ef26ba7b96e43d9520%252Fpa%252FXW90615_79a52d6977f3eb82f7e50ceacaf12ff4.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_79a52d6977f3eb82f7e50ceacaf12ff4.jpg saved to cache
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99928119-baaf-5c23-95e8-0856a6b17c54
2026-03-27 19:12:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99928119-baaf-5c23-95e8-0856a6b17c54, skipping ID generation
2026-03-27 19:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99928119-baaf-5c23-95e8-0856a6b17c54 with scrape type 1
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99928119-baaf-5c23-95e8-0856a6b17c54 sending to next pipeline
2026-03-27 19:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99928119-baaf-5c23-95e8-0856a6b17c54, identifier: XW90615
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_62bde64f59b1a4c57bccdccccb3ff2f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_62bde64f59b1a4c57bccdccccb3ff2f4.jpg not downloaded yet
2026-03-27 19:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615
2026-03-27 19:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615
2026-03-27 19:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615 to the API
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_79a52d6977f3eb82f7e50ceacaf12ff4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:44:55Z',
 'fuel_type': 'petrol',
 'id': '99928119-baaf-5c23-95e8-0856a6b17c54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW90615',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 124186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3747073,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_79a52d6977f3eb82f7e50ceacaf12ff4.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_34040960132d0aa6c0c7f18a19b96bdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_dabee727157c10a20f9d1d00b2a688bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_8a0a894580586e8be3471dac58e2c782.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_f923ac8da21b25dc339fbc9a45ac8c1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_18438bcf2d44161f00abe14954d0b580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_917045c1e6e1962a85064493ee98f9b1.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_761c560d533a8a6889b8c0efec555450.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_0792eacc6ff6cce59cacf190a5749ed3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99928119-baaf-5c23-95e8-0856a6b17c54/99928119-baaf-5c23-95e8-0856a6b17c54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/df/b8df3bca956119ef26ba7b96e43d9520/pa/XW90615_0f9da9e155fde00ba34d09eecd9fa709.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 EX",
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2008}
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-27 19:12:04 [auto1.nl] INFO: Saving data for XW90615: {'created_time': 1774638724.979343, 'last_price_update_time': 1774638724.979355, 'auction_closing_time': 1774716295.0}
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW90615') HTTP/1.1" 204 0
2026-03-27 19:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_dcf5c6afa22792ad36bc6f8b726cf519.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_d851bb199652b27b280ed59ba18ba156.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_d851bb199652b27b280ed59ba18ba156.jpg not downloaded yet
2026-03-27 19:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP12059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b2890>
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_f91b37217c59cf21ffdd6d3765032dc7.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_f91b37217c59cf21ffdd6d3765032dc7.jpg saved to cache
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 551244a0-76b8-5bfe-b60f-ac1146539bc4
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae336a850>
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_28ab928c9779a72dab09ac8602b6be76.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_28ab928c9779a72dab09ac8602b6be76.jpg saved to cache
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 551244a0-76b8-5bfe-b60f-ac1146539bc4
2026-03-27 19:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a26724a-46c7-5622-a89f-1089014ba93b with identifier: AM07460
2026-03-27 19:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a26724a-46c7-5622-a89f-1089014ba93b with scrape type 1
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_55d2c74be24a39b35545110f10c6a095.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_55d2c74be24a39b35545110f10c6a095.jpg not downloaded yet
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae329e910>
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_1327bddf48f3830e6c4159e34459b946.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_1327bddf48f3830e6c4159e34459b946.jpg saved to cache
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 551244a0-76b8-5bfe-b60f-ac1146539bc4
2026-03-27 19:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY58020/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW39949> (referer: https://www.auto1.com/v1/car-details-view/FW39949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_5a5723131f01f1ef157034bdd309b952.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_5a5723131f01f1ef157034bdd309b952.jpg not downloaded yet
2026-03-27 19:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_effcbf01c810e30d2759e8b50afd2ab9.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR99157> (referer: https://www.auto1.com/v1/car-details-view/UR99157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33b4bd0>
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_dcf5c6afa22792ad36bc6f8b726cf519.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_dcf5c6afa22792ad36bc6f8b726cf519.jpg saved to cache
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 551244a0-76b8-5bfe-b60f-ac1146539bc4
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_b61c2e4ad6af50026d3b05c0263767fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_b61c2e4ad6af50026d3b05c0263767fa.jpg not downloaded yet
2026-03-27 19:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_62bde64f59b1a4c57bccdccccb3ff2f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_4b6280517d2ec11ebbae918e9599979d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_5464f0f5fa58e6f881b0f3b8f740238b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_5464f0f5fa58e6f881b0f3b8f740238b.jpg not downloaded yet
2026-03-27 19:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6702191a-6f19-59d0-9093-d15b6bfd9f50 with identifier: FW39949
2026-03-27 19:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6702191a-6f19-59d0-9093-d15b6bfd9f50 with scrape type 1
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6702191a-6f19-59d0-9093-d15b6bfd9f50
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_067e8b883d1637e5e01a584c33a1591e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_067e8b883d1637e5e01a584c33a1591e.jpg already downloaded
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_695dd14f724f7949b613016c3f64b28b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_695dd14f724f7949b613016c3f64b28b.jpg already downloaded
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_3e609d6b5865de08bc1514bed93334e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_3e609d6b5865de08bc1514bed93334e8.jpg already downloaded
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_2a1db24fe6a47ae9f8d94ba8fed3643f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_2a1db24fe6a47ae9f8d94ba8fed3643f.jpg already downloaded
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_cbe911dd030cf2c4ea22570f737056cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_cbe911dd030cf2c4ea22570f737056cf.jpg already downloaded
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_cd5c210fa23ee1b3ed3a239ef268851a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_cd5c210fa23ee1b3ed3a239ef268851a.jpg already downloaded
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_888409efda82c67c78917aa96a076692.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_888409efda82c67c78917aa96a076692.jpg already downloaded
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_8fc9bba8b6357b4db066931684fa9a83.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_8fc9bba8b6357b4db066931684fa9a83.jpg already downloaded
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_ac699422d1fb3d8371f5e07220341d98.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_ac699422d1fb3d8371f5e07220341d98.jpg already downloaded
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F7d%252F477ddcb141bb530d843e2f6f2e8dc1cf%252Fpa%252FFW39949_a7173ae5173dbe4a3edfde6574bd4db1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_a7173ae5173dbe4a3edfde6574bd4db1.jpg already downloaded
2026-03-27 19:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6702191a-6f19-59d0-9093-d15b6bfd9f50, identifier: FW39949
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_763316361976e1a72f10c97a0c18e657.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_763316361976e1a72f10c97a0c18e657.jpg not downloaded yet
2026-03-27 19:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6702191a-6f19-59d0-9093-d15b6bfd9f50 with identifier: FW39949
2026-03-27 19:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6702191a-6f19-59d0-9093-d15b6bfd9f50 with identifier: FW39949
2026-03-27 19:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6702191a-6f19-59d0-9093-d15b6bfd9f50 with identifier: FW39949 to the API
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FW39949>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:33:13Z',
 'fuel_type': 'petrol',
 'id': '6702191a-6f19-59d0-9093-d15b6bfd9f50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R597SP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW39949',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 101520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_067e8b883d1637e5e01a584c33a1591e.jpg',
                'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_695dd14f724f7949b613016c3f64b28b.jpg',
                'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_3e609d6b5865de08bc1514bed93334e8.jpg',
                'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_2a1db24fe6a47ae9f8d94ba8fed3643f.jpg',
                'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_cbe911dd030cf2c4ea22570f737056cf.jpg',
                'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_cd5c210fa23ee1b3ed3a239ef268851a.jpg',
                'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_888409efda82c67c78917aa96a076692.jpg',
                'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_8fc9bba8b6357b4db066931684fa9a83.jpg',
                'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_ac699422d1fb3d8371f5e07220341d98.jpg',
                'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_a7173ae5173dbe4a3edfde6574bd4db1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_067e8b883d1637e5e01a584c33a1591e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_695dd14f724f7949b613016c3f64b28b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_3e609d6b5865de08bc1514bed93334e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_2a1db24fe6a47ae9f8d94ba8fed3643f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_cbe911dd030cf2c4ea22570f737056cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_cd5c210fa23ee1b3ed3a239ef268851a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_888409efda82c67c78917aa96a076692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_8fc9bba8b6357b4db066931684fa9a83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_ac699422d1fb3d8371f5e07220341d98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6702191a-6f19-59d0-9093-d15b6bfd9f50/6702191a-6f19-59d0-9093-d15b6bfd9f50_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/7d/477ddcb141bb530d843e2f6f2e8dc1cf/pa/FW39949_a7173ae5173dbe4a3edfde6574bd4db1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [auto1.nl] INFO: Saving data for FW39949: {'created_time': 1774638726.044862, 'last_price_update_time': 1774638726.044872, 'auction_closing_time': 1774715593.0}
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FW39949') HTTP/1.1" 204 0
2026-03-27 19:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_63c8c0bc35dec39d36ce35b044b4c77d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_cb680b16aa493e8f7cd978fb9765c57a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_cb680b16aa493e8f7cd978fb9765c57a.jpg not downloaded yet
2026-03-27 19:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB11708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae328b690>
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_effcbf01c810e30d2759e8b50afd2ab9.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_effcbf01c810e30d2759e8b50afd2ab9.jpg saved to cache
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949
2026-03-27 19:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with identifier: UR99157
2026-03-27 19:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with scrape type 1
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_f04374a475c963c7a54d6964770394ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_f04374a475c963c7a54d6964770394ca.jpg not downloaded yet
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae341e710>
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_62bde64f59b1a4c57bccdccccb3ff2f4.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_62bde64f59b1a4c57bccdccccb3ff2f4.jpg saved to cache
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2921890>
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_4b6280517d2ec11ebbae918e9599979d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_4b6280517d2ec11ebbae918e9599979d.jpg saved to cache
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949
2026-03-27 19:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_d851bb199652b27b280ed59ba18ba156.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL29526> (referer: https://www.auto1.com/v1/car-details-view/EL29526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR65933> (referer: https://www.auto1.com/v1/car-details-view/LR65933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_0c6470836146c8298125b09cd060e684.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_0c6470836146c8298125b09cd060e684.jpg not downloaded yet
2026-03-27 19:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_601cabf827c92331fa3dad2085ba1079.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_601cabf827c92331fa3dad2085ba1079.jpg not downloaded yet
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3581b10>
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_63c8c0bc35dec39d36ce35b044b4c77d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_63c8c0bc35dec39d36ce35b044b4c77d.jpg saved to cache
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_d5a34ffa702f821e8faeb27baea203f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_d5a34ffa702f821e8faeb27baea203f7.jpg not downloaded yet
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_76389d47ab6261716aa7842ba487f4fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_76389d47ab6261716aa7842ba487f4fe.jpg not downloaded yet
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_7ce9f4004c768ad8f73cb98e689462bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_7ce9f4004c768ad8f73cb98e689462bc.jpg not downloaded yet
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_cf459eda815bdc2adf2ce982348de105.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_cf459eda815bdc2adf2ce982348de105.jpg not downloaded yet
2026-03-27 19:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_f04374a475c963c7a54d6964770394ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_306a4a803fd70cbd3e7bc3252989d512.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_306a4a803fd70cbd3e7bc3252989d512.jpg not downloaded yet
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_ed9dba80b56bfe747e18054789c8fbe0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_ed9dba80b56bfe747e18054789c8fbe0.jpg not downloaded yet
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3380750>
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fea%252F8aea77fd6e42059bf3d09bce9e89bc0b%252Fpa%252FTW55830_d851bb199652b27b280ed59ba18ba156.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_d851bb199652b27b280ed59ba18ba156.jpg saved to cache
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949
2026-03-27 19:12:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7aee8ae9-e884-51bf-9f01-16d61bd3c949, skipping ID generation
2026-03-27 19:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with scrape type 1
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949 sending to next pipeline
2026-03-27 19:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7aee8ae9-e884-51bf-9f01-16d61bd3c949, identifier: TW55830
2026-03-27 19:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with identifier: EL29526
2026-03-27 19:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with scrape type 1
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_c5c99ef96346167526d73dcfef756b4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_c5c99ef96346167526d73dcfef756b4a.jpg not downloaded yet
2026-03-27 19:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9 with identifier: LR65933
2026-03-27 19:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9 with scrape type 1
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_e67343a61e1660d5b8c236bd09568cd7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_e67343a61e1660d5b8c236bd09568cd7.jpg not downloaded yet
2026-03-27 19:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with identifier: TW55830
2026-03-27 19:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with identifier: TW55830
2026-03-27 19:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with identifier: TW55830 to the API
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_d851bb199652b27b280ed59ba18ba156.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 2',
 'engine': '1.8L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:27:33Z',
 'fuel_type': 'petrol',
 'id': '7aee8ae9-e884-51bf-9f01-16d61bd3c949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '12THGT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW55830',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 349963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_63c8c0bc35dec39d36ce35b044b4c77d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_effcbf01c810e30d2759e8b50afd2ab9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_4b6280517d2ec11ebbae918e9599979d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_62bde64f59b1a4c57bccdccccb3ff2f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aee8ae9-e884-51bf-9f01-16d61bd3c949/7aee8ae9-e884-51bf-9f01-16d61bd3c949_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ea/8aea77fd6e42059bf3d09bce9e89bc0b/pa/TW55830_d851bb199652b27b280ed59ba18ba156.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-05-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 1.8 Turbo Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 1999}
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-27 19:12:06 [auto1.nl] INFO: Saving data for TW55830: {'created_time': 1774638726.996706, 'last_price_update_time': 1774638726.996717, 'auction_closing_time': 1774715253.0}
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TW55830') HTTP/1.1" 204 0
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_4773e456ca069c17a28dfaedbc4dade6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_4773e456ca069c17a28dfaedbc4dade6.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_a1edac3bb86e7cf0a379414dc5c1dbc0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_a1edac3bb86e7cf0a379414dc5c1dbc0.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_4fcdabdda2af0452c051b46747a260c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_4fcdabdda2af0452c051b46747a260c1.jpg not downloaded yet
2026-03-27 19:12:07 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 70 pages/min), scraped 160 items (at 85 items/min)
2026-03-27 19:12:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 19:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3349050>
2026-03-27 19:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_f04374a475c963c7a54d6964770394ca.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_f04374a475c963c7a54d6964770394ca.jpg saved to cache
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_cf459eda815bdc2adf2ce982348de105.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_96384c31e6b7a2096c448bb226a5c9b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_96384c31e6b7a2096c448bb226a5c9b3.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_95b52515556a1d5be560d37f5ed25483.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_95b52515556a1d5be560d37f5ed25483.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_5ee756b97cdefeeec933defc8abf5e72.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_5ee756b97cdefeeec933defc8abf5e72.jpg not downloaded yet
2026-03-27 19:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH64896> (referer: https://www.auto1.com/v1/car-details-view/EH64896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_efd57052745c78836bd5f6fa09232a81.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_efd57052745c78836bd5f6fa09232a81.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_2b73540dd04aa6a7e990247e9c5bab02.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_2b73540dd04aa6a7e990247e9c5bab02.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_9a884cd2349424787bdf72e00fb84e98.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_9a884cd2349424787bdf72e00fb84e98.jpg not downloaded yet
2026-03-27 19:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY75066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_fac09edf080cc735821f98a4d7545c09.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_fac09edf080cc735821f98a4d7545c09.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_ae9182321536a83668334a7d70d2f5a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_ae9182321536a83668334a7d70d2f5a3.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_037c6ddbdbeb9e0e819d4f274a2ea878.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_037c6ddbdbeb9e0e819d4f274a2ea878.jpg not downloaded yet
2026-03-27 19:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY93062> (referer: https://www.auto1.com/v1/car-details-view/PY93062/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_aaec52bfb4204ef7a002c667e432ebd6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_aaec52bfb4204ef7a002c667e432ebd6.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_436b7908a65daf475c08e915a2525645.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_436b7908a65daf475c08e915a2525645.jpg not downloaded yet
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_d050516fc9ae452381e9194f5397e7e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_d050516fc9ae452381e9194f5397e7e8.jpg not downloaded yet
2026-03-27 19:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae337c250>
2026-03-27 19:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_cf459eda815bdc2adf2ce982348de105.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_cf459eda815bdc2adf2ce982348de105.jpg saved to cache
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV84229> (referer: https://www.auto1.com/v1/car-details-view/GV84229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_e3c99adf95fd4c0002dd33ce2a2e39bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_e3c99adf95fd4c0002dd33ce2a2e39bc.jpg not downloaded yet
2026-03-27 19:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5f43aae-7eba-5d68-b4f0-69e3e6246574 with identifier: EH64896
2026-03-27 19:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5f43aae-7eba-5d68-b4f0-69e3e6246574 with scrape type 1
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5f43aae-7eba-5d68-b4f0-69e3e6246574
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_90bcb48badb5b7cd534299e623d3ad05.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_90bcb48badb5b7cd534299e623d3ad05.jpg already downloaded
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_d95b5f42dd02d7e86315a34c0c6049cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_d95b5f42dd02d7e86315a34c0c6049cc.jpg already downloaded
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_74b50a7662a9583797e84d1ba5186243.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_74b50a7662a9583797e84d1ba5186243.jpg already downloaded
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_d5c8b25d92686e9886b25804c0eb38cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_d5c8b25d92686e9886b25804c0eb38cc.jpg already downloaded
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_20a792f8f14d40f13b9d3be65be740b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_20a792f8f14d40f13b9d3be65be740b3.jpg already downloaded
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_371830d02ca5d7ca32feb7575bb66ed7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_371830d02ca5d7ca32feb7575bb66ed7.jpg already downloaded
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_f6b97224d70768a5fc93f8d078302d03.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_f6b97224d70768a5fc93f8d078302d03.jpg already downloaded
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_be3da4f0d66fe2e27a0efa27e128d827.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_be3da4f0d66fe2e27a0efa27e128d827.jpg already downloaded
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_cb9132113d98624216ca76a37f91d755.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_cb9132113d98624216ca76a37f91d755.jpg already downloaded
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa2%252F6ea22d0389da1226e0c17570b70dd831%252Fpa%252FEH64896_e5532c3f98ada0a0be242e61cbaa3573.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_e5532c3f98ada0a0be242e61cbaa3573.jpg already downloaded
2026-03-27 19:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5f43aae-7eba-5d68-b4f0-69e3e6246574, identifier: EH64896
2026-03-27 19:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5f43aae-7eba-5d68-b4f0-69e3e6246574 with identifier: EH64896
2026-03-27 19:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5f43aae-7eba-5d68-b4f0-69e3e6246574 with identifier: EH64896
2026-03-27 19:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5f43aae-7eba-5d68-b4f0-69e3e6246574 with identifier: EH64896 to the API
2026-03-27 19:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH64896>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:28:59Z',
 'fuel_type': 'hybrid',
 'id': 'e5f43aae-7eba-5d68-b4f0-69e3e6246574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'N247PN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH64896',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 41525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_90bcb48badb5b7cd534299e623d3ad05.jpg',
                'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_d95b5f42dd02d7e86315a34c0c6049cc.jpg',
                'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_74b50a7662a9583797e84d1ba5186243.jpg',
                'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_d5c8b25d92686e9886b25804c0eb38cc.jpg',
                'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_20a792f8f14d40f13b9d3be65be740b3.jpg',
                'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_371830d02ca5d7ca32feb7575bb66ed7.jpg',
                'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_f6b97224d70768a5fc93f8d078302d03.jpg',
                'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_be3da4f0d66fe2e27a0efa27e128d827.jpg',
                'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_cb9132113d98624216ca76a37f91d755.jpg',
                'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_e5532c3f98ada0a0be242e61cbaa3573.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_90bcb48badb5b7cd534299e623d3ad05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_d95b5f42dd02d7e86315a34c0c6049cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_74b50a7662a9583797e84d1ba5186243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_d5c8b25d92686e9886b25804c0eb38cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_20a792f8f14d40f13b9d3be65be740b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_371830d02ca5d7ca32feb7575bb66ed7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_f6b97224d70768a5fc93f8d078302d03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_be3da4f0d66fe2e27a0efa27e128d827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_cb9132113d98624216ca76a37f91d755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5f43aae-7eba-5d68-b4f0-69e3e6246574/e5f43aae-7eba-5d68-b4f0-69e3e6246574_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea22d0389da1226e0c17570b70dd831/pa/EH64896_e5532c3f98ada0a0be242e61cbaa3573.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 2.0 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2019}
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [auto1.nl] INFO: Saving data for EH64896: {'created_time': 1774638729.017565, 'last_price_update_time': 1774638729.017575, 'auction_closing_time': 1774715339.0}
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH64896') HTTP/1.1" 204 0
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_10b68fe123172ab682d3a5d71d6608a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_10b68fe123172ab682d3a5d71d6608a6.jpg not downloaded yet
2026-03-27 19:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY58020> (referer: https://www.auto1.com/v1/car-details-view/EY58020/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00abfc61-a1f5-51d6-9777-9c514a26915e with identifier: PY93062
2026-03-27 19:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00abfc61-a1f5-51d6-9777-9c514a26915e with scrape type 1
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 00abfc61-a1f5-51d6-9777-9c514a26915e
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_0206564b0e7e3093fde78f7691c3bbfc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_0206564b0e7e3093fde78f7691c3bbfc.jpg not downloaded yet
2026-03-27 19:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d25afc-c1a0-557d-869b-6a3a39f5e410 with identifier: GV84229
2026-03-27 19:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d25afc-c1a0-557d-869b-6a3a39f5e410 with scrape type 1
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 18d25afc-c1a0-557d-869b-6a3a39f5e410
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa5%252Fb9a55dba08c249f12cacfc213ad069ec%252Fpa%252FGV84229_c622765fb669db5b30a670daef419383.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_c622765fb669db5b30a670daef419383.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa5%252Fb9a55dba08c249f12cacfc213ad069ec%252Fpa%252FGV84229_cf3475bcb6bca606cea0f7cde42a120b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_cf3475bcb6bca606cea0f7cde42a120b.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa5%252Fb9a55dba08c249f12cacfc213ad069ec%252Fpa%252FGV84229_f2869bb2fde4c78c391733691aef48b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_f2869bb2fde4c78c391733691aef48b6.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa5%252Fb9a55dba08c249f12cacfc213ad069ec%252Fpa%252FGV84229_43309e6064c41452d733d99e878d1f0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_43309e6064c41452d733d99e878d1f0e.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa5%252Fb9a55dba08c249f12cacfc213ad069ec%252Fpa%252FGV84229_7a4acabf1f2e33ffc6b89bc2b23fd38e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_7a4acabf1f2e33ffc6b89bc2b23fd38e.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa5%252Fb9a55dba08c249f12cacfc213ad069ec%252Fpa%252FGV84229_2552afc5735278b2c3b389aa7f785da7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_2552afc5735278b2c3b389aa7f785da7.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa5%252Fb9a55dba08c249f12cacfc213ad069ec%252Fpa%252FGV84229_6a8ed19c8a98ca3ccce43d4cc6a2a2a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_6a8ed19c8a98ca3ccce43d4cc6a2a2a4.jpg already downloaded
2026-03-27 19:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 18d25afc-c1a0-557d-869b-6a3a39f5e410, identifier: GV84229
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_7d7063e0f6356a403f4f41675b7f8f8c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_7d7063e0f6356a403f4f41675b7f8f8c.jpg not downloaded yet
2026-03-27 19:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP12059> (referer: https://www.auto1.com/v1/car-details-view/ZP12059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN89359> (referer: https://www.auto1.com/v1/car-details-view/GN89359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 18d25afc-c1a0-557d-869b-6a3a39f5e410 with identifier: GV84229
2026-03-27 19:12:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 18d25afc-c1a0-557d-869b-6a3a39f5e410 with identifier: GV84229
2026-03-27 19:12:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 18d25afc-c1a0-557d-869b-6a3a39f5e410 with identifier: GV84229 to the API
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GV84229>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:56:46Z',
 'fuel_type': 'diesel',
 'id': '18d25afc-c1a0-557d-869b-6a3a39f5e410',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'V552SZ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV84229',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 191969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_c622765fb669db5b30a670daef419383.jpg',
                'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_cf3475bcb6bca606cea0f7cde42a120b.jpg',
                'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_f2869bb2fde4c78c391733691aef48b6.jpg',
                'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_43309e6064c41452d733d99e878d1f0e.jpg',
                'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_7a4acabf1f2e33ffc6b89bc2b23fd38e.jpg',
                'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_2552afc5735278b2c3b389aa7f785da7.jpg',
                'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_6a8ed19c8a98ca3ccce43d4cc6a2a2a4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d25afc-c1a0-557d-869b-6a3a39f5e410/18d25afc-c1a0-557d-869b-6a3a39f5e410_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_c622765fb669db5b30a670daef419383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d25afc-c1a0-557d-869b-6a3a39f5e410/18d25afc-c1a0-557d-869b-6a3a39f5e410_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_cf3475bcb6bca606cea0f7cde42a120b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d25afc-c1a0-557d-869b-6a3a39f5e410/18d25afc-c1a0-557d-869b-6a3a39f5e410_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_f2869bb2fde4c78c391733691aef48b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d25afc-c1a0-557d-869b-6a3a39f5e410/18d25afc-c1a0-557d-869b-6a3a39f5e410_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_43309e6064c41452d733d99e878d1f0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d25afc-c1a0-557d-869b-6a3a39f5e410/18d25afc-c1a0-557d-869b-6a3a39f5e410_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_7a4acabf1f2e33ffc6b89bc2b23fd38e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d25afc-c1a0-557d-869b-6a3a39f5e410/18d25afc-c1a0-557d-869b-6a3a39f5e410_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_2552afc5735278b2c3b389aa7f785da7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d25afc-c1a0-557d-869b-6a3a39f5e410/18d25afc-c1a0-557d-869b-6a3a39f5e410_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a5/b9a55dba08c249f12cacfc213ad069ec/pa/GV84229_6a8ed19c8a98ca3ccce43d4cc6a2a2a4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Kasten BlueMotion',
 'year': 2018}
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV84229%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [auto1.nl] INFO: Saving data for GV84229: {'created_time': 1774638729.574735, 'last_price_update_time': 1774638729.574745, 'auction_closing_time': 1774717006.0}
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV84229') HTTP/1.1" 204 0
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_258c1290d43ec1c74af3adb77a73cfc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_258c1290d43ec1c74af3adb77a73cfc2.jpg not downloaded yet
2026-03-27 19:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_ed1ee642477e5e6d480e114bdad8009f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_ed1ee642477e5e6d480e114bdad8009f.jpg not downloaded yet
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_8552506a9f1265a9ab93a762f0d142a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_8552506a9f1265a9ab93a762f0d142a6.jpg not downloaded yet
2026-03-27 19:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with identifier: EY58020
2026-03-27 19:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with scrape type 1
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_b87aabacbc63899a82e4f9659b3d9e69.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_b87aabacbc63899a82e4f9659b3d9e69.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_11bf07bc0145176cfdfd0e0a535dfe78.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_11bf07bc0145176cfdfd0e0a535dfe78.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_c4c268b43a774b73bbd9a6fdfb00c700.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_c4c268b43a774b73bbd9a6fdfb00c700.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_7f38796e09b71c79fa49f7264e12f16f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_7f38796e09b71c79fa49f7264e12f16f.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_7558c982435bca13485f1c8e1ab74115.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_7558c982435bca13485f1c8e1ab74115.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_6362a12b4a45f3dbc4d9259d929198bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_6362a12b4a45f3dbc4d9259d929198bd.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_9e92c0a0efdc2d07a94fb651b9662ab1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_9e92c0a0efdc2d07a94fb651b9662ab1.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_78d8c7152a4ff4a32f62b32cf1d0da21.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_78d8c7152a4ff4a32f62b32cf1d0da21.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_d57696a6bb6254cf38cef20670ca8745.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_d57696a6bb6254cf38cef20670ca8745.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F1f%252F1a1f3c27205c3da942021b4c3f990b38%252Fpa%252FEY58020_8e787c0a60612d517f0b0ec10ba20f91.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_8e787c0a60612d517f0b0ec10ba20f91.jpg already downloaded
2026-03-27 19:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868, identifier: EY58020
2026-03-27 19:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93f63994-d7bf-519d-8066-503aa599c4cd with identifier: ZP12059
2026-03-27 19:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93f63994-d7bf-519d-8066-503aa599c4cd with scrape type 1
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 93f63994-d7bf-519d-8066-503aa599c4cd
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F61%252F1f61e8a9bd05d427b26dc076cc2cb362%252Fpa%252FZP12059_197f53fbfdeca71eba7732b009e0a321.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_197f53fbfdeca71eba7732b009e0a321.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F61%252F1f61e8a9bd05d427b26dc076cc2cb362%252Fpa%252FZP12059_fa9402c8e2afbc7aedc177adc92bbb2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_fa9402c8e2afbc7aedc177adc92bbb2d.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F61%252F1f61e8a9bd05d427b26dc076cc2cb362%252Fpa%252FZP12059_339f60684c61e332f2102d13e28b12a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_339f60684c61e332f2102d13e28b12a3.jpg already downloaded
2026-03-27 19:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F61%252F1f61e8a9bd05d427b26dc076cc2cb362%252Fpa%252FZP12059_5fe24bb83deba0ec56bb53a8898e34ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_5fe24bb83deba0ec56bb53a8898e34ff.jpg already downloaded
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F61%252F1f61e8a9bd05d427b26dc076cc2cb362%252Fpa%252FZP12059_de861c0ec0089997282bd25d1235205d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_de861c0ec0089997282bd25d1235205d.jpg already downloaded
2026-03-27 19:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 93f63994-d7bf-519d-8066-503aa599c4cd, identifier: ZP12059
2026-03-27 19:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da8523f-5424-53e9-9206-8cba63f46b4f with identifier: GN89359
2026-03-27 19:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da8523f-5424-53e9-9206-8cba63f46b4f with scrape type 1
2026-03-27 19:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 4da8523f-5424-53e9-9206-8cba63f46b4f
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fce%252F48ce8ce868000a671ed75b998e7f2de3%252Fpa%252FGN89359_96c94fcc855d2ba3602d18dd1fe23653.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_96c94fcc855d2ba3602d18dd1fe23653.jpg not downloaded yet
2026-03-27 19:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_4ba161b36ba924a449605f672c3cdb01.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_7f348e7d91e5e25839a12c5a33c4ecb6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_7f348e7d91e5e25839a12c5a33c4ecb6.jpg not downloaded yet
2026-03-27 19:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with identifier: EY58020
2026-03-27 19:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with identifier: EY58020
2026-03-27 19:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with identifier: EY58020 to the API
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY58020>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:03:45Z',
 'fuel_type': 'petrol',
 'id': 'f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K947HJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY58020',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 172980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_b87aabacbc63899a82e4f9659b3d9e69.jpg',
                'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_11bf07bc0145176cfdfd0e0a535dfe78.jpg',
                'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_c4c268b43a774b73bbd9a6fdfb00c700.jpg',
                'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_7f38796e09b71c79fa49f7264e12f16f.jpg',
                'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_7558c982435bca13485f1c8e1ab74115.jpg',
                'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_6362a12b4a45f3dbc4d9259d929198bd.jpg',
                'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_9e92c0a0efdc2d07a94fb651b9662ab1.jpg',
                'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_78d8c7152a4ff4a32f62b32cf1d0da21.jpg',
                'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_d57696a6bb6254cf38cef20670ca8745.jpg',
                'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_8e787c0a60612d517f0b0ec10ba20f91.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_b87aabacbc63899a82e4f9659b3d9e69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_11bf07bc0145176cfdfd0e0a535dfe78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_c4c268b43a774b73bbd9a6fdfb00c700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_7f38796e09b71c79fa49f7264e12f16f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_7558c982435bca13485f1c8e1ab74115.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_6362a12b4a45f3dbc4d9259d929198bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_9e92c0a0efdc2d07a94fb651b9662ab1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_78d8c7152a4ff4a32f62b32cf1d0da21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_d57696a6bb6254cf38cef20670ca8745.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868/f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/1f/1a1f3c27205c3da942021b4c3f990b38/pa/EY58020_8e787c0a60612d517f0b0ec10ba20f91.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2013}
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-27 19:12:10 [auto1.nl] INFO: Saving data for EY58020: {'created_time': 1774638730.43452, 'last_price_update_time': 1774638730.434531, 'auction_closing_time': 1774713825.0}
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY58020') HTTP/1.1" 204 0
2026-03-27 19:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 93f63994-d7bf-519d-8066-503aa599c4cd with identifier: ZP12059
2026-03-27 19:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 93f63994-d7bf-519d-8066-503aa599c4cd with identifier: ZP12059
2026-03-27 19:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 93f63994-d7bf-519d-8066-503aa599c4cd with identifier: ZP12059 to the API
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZP12059>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:46:13Z',
 'fuel_type': 'petrol',
 'id': '93f63994-d7bf-519d-8066-503aa599c4cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '33KLD9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP12059',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 252448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_197f53fbfdeca71eba7732b009e0a321.jpg',
                'https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_fa9402c8e2afbc7aedc177adc92bbb2d.jpg',
                'https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_339f60684c61e332f2102d13e28b12a3.jpg',
                'https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_5fe24bb83deba0ec56bb53a8898e34ff.jpg',
                'https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_de861c0ec0089997282bd25d1235205d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f63994-d7bf-519d-8066-503aa599c4cd/93f63994-d7bf-519d-8066-503aa599c4cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_197f53fbfdeca71eba7732b009e0a321.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f63994-d7bf-519d-8066-503aa599c4cd/93f63994-d7bf-519d-8066-503aa599c4cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_fa9402c8e2afbc7aedc177adc92bbb2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f63994-d7bf-519d-8066-503aa599c4cd/93f63994-d7bf-519d-8066-503aa599c4cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_339f60684c61e332f2102d13e28b12a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f63994-d7bf-519d-8066-503aa599c4cd/93f63994-d7bf-519d-8066-503aa599c4cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_5fe24bb83deba0ec56bb53a8898e34ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f63994-d7bf-519d-8066-503aa599c4cd/93f63994-d7bf-519d-8066-503aa599c4cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/61/1f61e8a9bd05d427b26dc076cc2cb362/pa/ZP12059_de861c0ec0089997282bd25d1235205d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2010}
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-27 19:12:10 [auto1.nl] INFO: Saving data for ZP12059: {'created_time': 1774638730.731176, 'last_price_update_time': 1774638730.731187, 'auction_closing_time': 1774716373.0}
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP12059') HTTP/1.1" 204 0
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fce%252F48ce8ce868000a671ed75b998e7f2de3%252Fpa%252FGN89359_095b257a9be62b4b5cbefde18e116199.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_095b257a9be62b4b5cbefde18e116199.jpg not downloaded yet
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_3aafecf52ef3b83f1e1ec4276e5fd84d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_3aafecf52ef3b83f1e1ec4276e5fd84d.jpg not downloaded yet
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fce%252F48ce8ce868000a671ed75b998e7f2de3%252Fpa%252FGN89359_c29d40ce959dca9317745032aae4ef3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_c29d40ce959dca9317745032aae4ef3c.jpg not downloaded yet
2026-03-27 19:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH59991> (referer: https://www.auto1.com/v1/car-details-view/HH59991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae358d4d0>
2026-03-27 19:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_4ba161b36ba924a449605f672c3cdb01.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_4ba161b36ba924a449605f672c3cdb01.jpg saved to cache
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fce%252F48ce8ce868000a671ed75b998e7f2de3%252Fpa%252FGN89359_db4e51d84cf7260211df847bc92ba35a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_db4e51d84cf7260211df847bc92ba35a.jpg not downloaded yet
2026-03-27 19:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_a1edac3bb86e7cf0a379414dc5c1dbc0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944078ff-8508-529b-b331-0e23c3692d98 with identifier: HH59991
2026-03-27 19:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944078ff-8508-529b-b331-0e23c3692d98 with scrape type 1
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_e50a3e8700a12689cfcaacd459701f1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_e50a3e8700a12689cfcaacd459701f1c.jpg not downloaded yet
2026-03-27 19:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_55d2c74be24a39b35545110f10c6a095.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_5a5723131f01f1ef157034bdd309b952.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_b61c2e4ad6af50026d3b05c0263767fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_e9eeebd607edebf9db5ea36245b778e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_e9eeebd607edebf9db5ea36245b778e3.jpg not downloaded yet
2026-03-27 19:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_763316361976e1a72f10c97a0c18e657.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_cb680b16aa493e8f7cd978fb9765c57a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_0032444b4eac850dc6dd11b8f27714d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_0032444b4eac850dc6dd11b8f27714d8.jpg not downloaded yet
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_c6386fd49b5f3ab5965b37f56d373d3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_c6386fd49b5f3ab5965b37f56d373d3e.jpg not downloaded yet
2026-03-27 19:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_5464f0f5fa58e6f881b0f3b8f740238b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_d948ec711322278fe281d4f06e6b4bed.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_d948ec711322278fe281d4f06e6b4bed.jpg not downloaded yet
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32b0d90>
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_a1edac3bb86e7cf0a379414dc5c1dbc0.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_a1edac3bb86e7cf0a379414dc5c1dbc0.jpg saved to cache
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0
2026-03-27 19:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_8552506a9f1265a9ab93a762f0d142a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_0206564b0e7e3093fde78f7691c3bbfc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_199d817afdcc82e6d2c1d68f5776786f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_199d817afdcc82e6d2c1d68f5776786f.jpg not downloaded yet
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_98949cb947e9eb46a802c93558f4ee54.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_98949cb947e9eb46a802c93558f4ee54.jpg not downloaded yet
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_6a6a2e036002053581d5f08fec4617b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_6a6a2e036002053581d5f08fec4617b8.jpg not downloaded yet
2026-03-27 19:12:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3467610>
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_55d2c74be24a39b35545110f10c6a095.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_55d2c74be24a39b35545110f10c6a095.jpg saved to cache
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b24d0>
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_5a5723131f01f1ef157034bdd309b952.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_5a5723131f01f1ef157034bdd309b952.jpg saved to cache
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae826e0d0>
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_b61c2e4ad6af50026d3b05c0263767fa.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_b61c2e4ad6af50026d3b05c0263767fa.jpg saved to cache
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3359d50>
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_763316361976e1a72f10c97a0c18e657.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_763316361976e1a72f10c97a0c18e657.jpg saved to cache
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2950210>
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_cb680b16aa493e8f7cd978fb9765c57a.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_cb680b16aa493e8f7cd978fb9765c57a.jpg saved to cache
2026-03-27 19:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae332a750>
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_5464f0f5fa58e6f881b0f3b8f740238b.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_5464f0f5fa58e6f881b0f3b8f740238b.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_3aafecf52ef3b83f1e1ec4276e5fd84d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_131c13d4b150f75d30e7f1f99ba778d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_131c13d4b150f75d30e7f1f99ba778d5.jpg not downloaded yet
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_c29d40ce959dca9317745032aae4ef3c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY75066> (referer: https://www.auto1.com/v1/car-details-view/RY75066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_4fcdabdda2af0452c051b46747a260c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_2cf60eabf84bd85c3f5a3ce8aafbc932.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_2cf60eabf84bd85c3f5a3ce8aafbc932.jpg not downloaded yet
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2982d90>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_8552506a9f1265a9ab93a762f0d142a6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_8552506a9f1265a9ab93a762f0d142a6.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00abfc61-a1f5-51d6-9777-9c514a26915e
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2910110>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_0206564b0e7e3093fde78f7691c3bbfc.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_0206564b0e7e3093fde78f7691c3bbfc.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00abfc61-a1f5-51d6-9777-9c514a26915e
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3299110>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_3aafecf52ef3b83f1e1ec4276e5fd84d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_3aafecf52ef3b83f1e1ec4276e5fd84d.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00abfc61-a1f5-51d6-9777-9c514a26915e
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3341990>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da8523f-5424-53e9-9206-8cba63f46b4f/4da8523f-5424-53e9-9206-8cba63f46b4f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fce%252F48ce8ce868000a671ed75b998e7f2de3%252Fpa%252FGN89359_c29d40ce959dca9317745032aae4ef3c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_c29d40ce959dca9317745032aae4ef3c.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4da8523f-5424-53e9-9206-8cba63f46b4f
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_d948ec711322278fe281d4f06e6b4bed.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_6a6a2e036002053581d5f08fec4617b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_98949cb947e9eb46a802c93558f4ee54.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_199d817afdcc82e6d2c1d68f5776786f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311297b7-5f2a-5400-9ef6-c2969c2cd85f with identifier: RY75066
2026-03-27 19:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f with scrape type 1
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_92da10f8e9190b2a919848eee85911ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_92da10f8e9190b2a919848eee85911ab.jpg not downloaded yet
2026-03-27 19:12:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3405c50>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_4fcdabdda2af0452c051b46747a260c1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_4fcdabdda2af0452c051b46747a260c1.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_cc404e59c0442826bf6a8ce492d5aab3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_cc404e59c0442826bf6a8ce492d5aab3.jpg not downloaded yet
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_036a3a2816ba79e19f50d455b9bb5c5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_036a3a2816ba79e19f50d455b9bb5c5a.jpg not downloaded yet
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2978990>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_d948ec711322278fe281d4f06e6b4bed.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_d948ec711322278fe281d4f06e6b4bed.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29d23d0>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_6a6a2e036002053581d5f08fec4617b8.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_6a6a2e036002053581d5f08fec4617b8.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34959d0>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_98949cb947e9eb46a802c93558f4ee54.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_98949cb947e9eb46a802c93558f4ee54.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3496190>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_199d817afdcc82e6d2c1d68f5776786f.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_199d817afdcc82e6d2c1d68f5776786f.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_c6125b631f50ece6fccb6122aad72024.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_c6125b631f50ece6fccb6122aad72024.jpg not downloaded yet
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_0032444b4eac850dc6dd11b8f27714d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_e9eeebd607edebf9db5ea36245b778e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_c6386fd49b5f3ab5965b37f56d373d3e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_e50a3e8700a12689cfcaacd459701f1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_545747e1421dfc091b4f47a290fb6ba7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_545747e1421dfc091b4f47a290fb6ba7.jpg not downloaded yet
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_aaa96b5f91d1ad001dfcafafb56b7954.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_aaa96b5f91d1ad001dfcafafb56b7954.jpg not downloaded yet
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_cf99603abf5f53b100605732ed3f2b67.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_cf99603abf5f53b100605732ed3f2b67.jpg not downloaded yet
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_287895078530805347db18ef1c0fec12.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_287895078530805347db18ef1c0fec12.jpg not downloaded yet
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_9a884cd2349424787bdf72e00fb84e98.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_db4e51d84cf7260211df847bc92ba35a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_095b257a9be62b4b5cbefde18e116199.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_d90f8470b1a21ade4a3309a9462c84d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_d90f8470b1a21ade4a3309a9462c84d2.jpg not downloaded yet
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_7f348e7d91e5e25839a12c5a33c4ecb6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_131c13d4b150f75d30e7f1f99ba778d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_271dc06c513afc6167e7b1726b822637.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_271dc06c513afc6167e7b1726b822637.jpg not downloaded yet
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9335310>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_0032444b4eac850dc6dd11b8f27714d8.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_0032444b4eac850dc6dd11b8f27714d8.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34db0d0>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_e9eeebd607edebf9db5ea36245b778e3.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_e9eeebd607edebf9db5ea36245b778e3.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_d050516fc9ae452381e9194f5397e7e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_2cf60eabf84bd85c3f5a3ce8aafbc932.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_036a3a2816ba79e19f50d455b9bb5c5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34dba10>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_c6386fd49b5f3ab5965b37f56d373d3e.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_c6386fd49b5f3ab5965b37f56d373d3e.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3348e90>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_e50a3e8700a12689cfcaacd459701f1c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_e50a3e8700a12689cfcaacd459701f1c.jpg saved to cache
2026-03-27 19:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_10b68fe123172ab682d3a5d71d6608a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_96c94fcc855d2ba3602d18dd1fe23653.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_258c1290d43ec1c74af3adb77a73cfc2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_037c6ddbdbeb9e0e819d4f274a2ea878.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35f0b50>
2026-03-27 19:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_9a884cd2349424787bdf72e00fb84e98.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_9a884cd2349424787bdf72e00fb84e98.jpg saved to cache
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae346ec50>
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da8523f-5424-53e9-9206-8cba63f46b4f/4da8523f-5424-53e9-9206-8cba63f46b4f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fce%252F48ce8ce868000a671ed75b998e7f2de3%252Fpa%252FGN89359_db4e51d84cf7260211df847bc92ba35a.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_db4e51d84cf7260211df847bc92ba35a.jpg saved to cache
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4da8523f-5424-53e9-9206-8cba63f46b4f
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3487e10>
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da8523f-5424-53e9-9206-8cba63f46b4f/4da8523f-5424-53e9-9206-8cba63f46b4f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fce%252F48ce8ce868000a671ed75b998e7f2de3%252Fpa%252FGN89359_095b257a9be62b4b5cbefde18e116199.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_095b257a9be62b4b5cbefde18e116199.jpg saved to cache
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4da8523f-5424-53e9-9206-8cba63f46b4f
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3593990>
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_7f348e7d91e5e25839a12c5a33c4ecb6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_7f348e7d91e5e25839a12c5a33c4ecb6.jpg saved to cache
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00abfc61-a1f5-51d6-9777-9c514a26915e
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29e6a90>
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_131c13d4b150f75d30e7f1f99ba778d5.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_131c13d4b150f75d30e7f1f99ba778d5.jpg saved to cache
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9382410>
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_d050516fc9ae452381e9194f5397e7e8.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_d050516fc9ae452381e9194f5397e7e8.jpg saved to cache
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33f7f90>
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F19%252Fd519fbfeb064841ebf42ac9e11b5754a%252Fpa%252FHH59991_2cf60eabf84bd85c3f5a3ce8aafbc932.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_2cf60eabf84bd85c3f5a3ce8aafbc932.jpg saved to cache
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 944078ff-8508-529b-b331-0e23c3692d98
2026-03-27 19:12:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 944078ff-8508-529b-b331-0e23c3692d98, skipping ID generation
2026-03-27 19:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944078ff-8508-529b-b331-0e23c3692d98 with scrape type 1
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 944078ff-8508-529b-b331-0e23c3692d98 sending to next pipeline
2026-03-27 19:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 944078ff-8508-529b-b331-0e23c3692d98, identifier: HH59991
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35a0150>
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_036a3a2816ba79e19f50d455b9bb5c5a.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_036a3a2816ba79e19f50d455b9bb5c5a.jpg saved to cache
2026-03-27 19:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 944078ff-8508-529b-b331-0e23c3692d98 with identifier: HH59991
2026-03-27 19:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 944078ff-8508-529b-b331-0e23c3692d98 with identifier: HH59991
2026-03-27 19:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 944078ff-8508-529b-b331-0e23c3692d98 with identifier: HH59991 to the API
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_2cf60eabf84bd85c3f5a3ce8aafbc932.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:03:43Z',
 'fuel_type': 'petrol',
 'id': '944078ff-8508-529b-b331-0e23c3692d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH59991',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 72513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_e50a3e8700a12689cfcaacd459701f1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_e9eeebd607edebf9db5ea36245b778e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_0032444b4eac850dc6dd11b8f27714d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_c6386fd49b5f3ab5965b37f56d373d3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_d948ec711322278fe281d4f06e6b4bed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_199d817afdcc82e6d2c1d68f5776786f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_98949cb947e9eb46a802c93558f4ee54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_6a6a2e036002053581d5f08fec4617b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_131c13d4b150f75d30e7f1f99ba778d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944078ff-8508-529b-b331-0e23c3692d98/944078ff-8508-529b-b331-0e23c3692d98_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/19/d519fbfeb064841ebf42ac9e11b5754a/pa/HH59991_2cf60eabf84bd85c3f5a3ce8aafbc932.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59991%27 HTTP/1.1" 200 None
2026-03-27 19:12:14 [auto1.nl] INFO: Saving data for HH59991: {'created_time': 1774638734.021939, 'last_price_update_time': 1774638734.02195, 'auction_closing_time': 1774713823.0}
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HH59991') HTTP/1.1" 204 0
2026-03-27 19:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_cf99603abf5f53b100605732ed3f2b67.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_545747e1421dfc091b4f47a290fb6ba7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_92da10f8e9190b2a919848eee85911ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_cc404e59c0442826bf6a8ce492d5aab3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_287895078530805347db18ef1c0fec12.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_c6125b631f50ece6fccb6122aad72024.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_aaa96b5f91d1ad001dfcafafb56b7954.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33a3c50>
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_10b68fe123172ab682d3a5d71d6608a6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_10b68fe123172ab682d3a5d71d6608a6.jpg saved to cache
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29f7ed0>
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da8523f-5424-53e9-9206-8cba63f46b4f/4da8523f-5424-53e9-9206-8cba63f46b4f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fce%252F48ce8ce868000a671ed75b998e7f2de3%252Fpa%252FGN89359_96c94fcc855d2ba3602d18dd1fe23653.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_96c94fcc855d2ba3602d18dd1fe23653.jpg saved to cache
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4da8523f-5424-53e9-9206-8cba63f46b4f
2026-03-27 19:12:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4da8523f-5424-53e9-9206-8cba63f46b4f, skipping ID generation
2026-03-27 19:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da8523f-5424-53e9-9206-8cba63f46b4f with scrape type 1
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4da8523f-5424-53e9-9206-8cba63f46b4f sending to next pipeline
2026-03-27 19:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4da8523f-5424-53e9-9206-8cba63f46b4f, identifier: GN89359
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32afcd0>
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F5e%252F6e5e1c090bd531b40bf6bf4878351f3c%252Fpa%252FPY93062_258c1290d43ec1c74af3adb77a73cfc2.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_258c1290d43ec1c74af3adb77a73cfc2.jpg saved to cache
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00abfc61-a1f5-51d6-9777-9c514a26915e
2026-03-27 19:12:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00abfc61-a1f5-51d6-9777-9c514a26915e, skipping ID generation
2026-03-27 19:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00abfc61-a1f5-51d6-9777-9c514a26915e with scrape type 1
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00abfc61-a1f5-51d6-9777-9c514a26915e sending to next pipeline
2026-03-27 19:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 00abfc61-a1f5-51d6-9777-9c514a26915e, identifier: PY93062
2026-03-27 19:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae357b450>
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_037c6ddbdbeb9e0e819d4f274a2ea878.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_037c6ddbdbeb9e0e819d4f274a2ea878.jpg saved to cache
2026-03-27 19:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4da8523f-5424-53e9-9206-8cba63f46b4f with identifier: GN89359
2026-03-27 19:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4da8523f-5424-53e9-9206-8cba63f46b4f with identifier: GN89359
2026-03-27 19:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4da8523f-5424-53e9-9206-8cba63f46b4f with identifier: GN89359 to the API
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_96c94fcc855d2ba3602d18dd1fe23653.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:18:09Z',
 'fuel_type': 'petrol',
 'id': '4da8523f-5424-53e9-9206-8cba63f46b4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '89NRDR',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN89359',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 177662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da8523f-5424-53e9-9206-8cba63f46b4f/4da8523f-5424-53e9-9206-8cba63f46b4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_96c94fcc855d2ba3602d18dd1fe23653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da8523f-5424-53e9-9206-8cba63f46b4f/4da8523f-5424-53e9-9206-8cba63f46b4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_095b257a9be62b4b5cbefde18e116199.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da8523f-5424-53e9-9206-8cba63f46b4f/4da8523f-5424-53e9-9206-8cba63f46b4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_c29d40ce959dca9317745032aae4ef3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da8523f-5424-53e9-9206-8cba63f46b4f/4da8523f-5424-53e9-9206-8cba63f46b4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ce/48ce8ce868000a671ed75b998e7f2de3/pa/GN89359_db4e51d84cf7260211df847bc92ba35a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-01-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-27 19:12:15 [auto1.nl] INFO: Saving data for GN89359: {'created_time': 1774638735.061754, 'last_price_update_time': 1774638735.061765, 'auction_closing_time': 1774714689.0}
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN89359') HTTP/1.1" 204 0
2026-03-27 19:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 00abfc61-a1f5-51d6-9777-9c514a26915e with identifier: PY93062
2026-03-27 19:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 00abfc61-a1f5-51d6-9777-9c514a26915e with identifier: PY93062
2026-03-27 19:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 00abfc61-a1f5-51d6-9777-9c514a26915e with identifier: PY93062 to the API
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_258c1290d43ec1c74af3adb77a73cfc2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:15:07Z',
 'fuel_type': 'petrol',
 'id': '00abfc61-a1f5-51d6-9777-9c514a26915e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '27XRSB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY93062',
 'listing': 'auction',
 'location': 'NL, Apeldoorn',
 'make': 'Volkswagen',
 'model': 'Eos',
 'odometer': 187052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_0206564b0e7e3093fde78f7691c3bbfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_258c1290d43ec1c74af3adb77a73cfc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_8552506a9f1265a9ab93a762f0d142a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_7f348e7d91e5e25839a12c5a33c4ecb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00abfc61-a1f5-51d6-9777-9c514a26915e/00abfc61-a1f5-51d6-9777-9c514a26915e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/5e/6e5e1c090bd531b40bf6bf4878351f3c/pa/PY93062_3aafecf52ef3b83f1e1ec4276e5fd84d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-08-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Eos 2.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-27 19:12:15 [auto1.nl] INFO: Saving data for PY93062: {'created_time': 1774638735.379998, 'last_price_update_time': 1774638735.38001, 'auction_closing_time': 1774714507.0}
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY93062') HTTP/1.1" 204 0
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32aa1d0>
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_cf99603abf5f53b100605732ed3f2b67.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_cf99603abf5f53b100605732ed3f2b67.jpg saved to cache
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34d2dd0>
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_545747e1421dfc091b4f47a290fb6ba7.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_545747e1421dfc091b4f47a290fb6ba7.jpg saved to cache
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae281d010>
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_92da10f8e9190b2a919848eee85911ab.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_92da10f8e9190b2a919848eee85911ab.jpg saved to cache
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29d28d0>
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_cc404e59c0442826bf6a8ce492d5aab3.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_cc404e59c0442826bf6a8ce492d5aab3.jpg saved to cache
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2917ed0>
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_287895078530805347db18ef1c0fec12.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_287895078530805347db18ef1c0fec12.jpg saved to cache
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32b9b90>
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_c6125b631f50ece6fccb6122aad72024.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_c6125b631f50ece6fccb6122aad72024.jpg saved to cache
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2832150>
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_aaa96b5f91d1ad001dfcafafb56b7954.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_aaa96b5f91d1ad001dfcafafb56b7954.jpg saved to cache
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_7d7063e0f6356a403f4f41675b7f8f8c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_ed1ee642477e5e6d480e114bdad8009f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_271dc06c513afc6167e7b1726b822637.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_436b7908a65daf475c08e915a2525645.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_fac09edf080cc735821f98a4d7545c09.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_d90f8470b1a21ade4a3309a9462c84d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_ae9182321536a83668334a7d70d2f5a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_2b73540dd04aa6a7e990247e9c5bab02.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_aaec52bfb4204ef7a002c667e432ebd6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_efd57052745c78836bd5f6fa09232a81.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9672210>
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_7d7063e0f6356a403f4f41675b7f8f8c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_7d7063e0f6356a403f4f41675b7f8f8c.jpg saved to cache
2026-03-27 19:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2903a10>
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_ed1ee642477e5e6d480e114bdad8009f.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_ed1ee642477e5e6d480e114bdad8009f.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_96384c31e6b7a2096c448bb226a5c9b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_95b52515556a1d5be560d37f5ed25483.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_4773e456ca069c17a28dfaedbc4dade6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29430d0>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_271dc06c513afc6167e7b1726b822637.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_271dc06c513afc6167e7b1726b822637.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29d2c10>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_436b7908a65daf475c08e915a2525645.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_436b7908a65daf475c08e915a2525645.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae966ee50>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_fac09edf080cc735821f98a4d7545c09.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_fac09edf080cc735821f98a4d7545c09.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2977a10>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F59%252Fb259b3e436816f887c63b1e74eda9062%252Fpa%252FRY75066_d90f8470b1a21ade4a3309a9462c84d2.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_d90f8470b1a21ade4a3309a9462c84d2.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f
2026-03-27 19:12:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 311297b7-5f2a-5400-9ef6-c2969c2cd85f, skipping ID generation
2026-03-27 19:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f with scrape type 1
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f sending to next pipeline
2026-03-27 19:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 311297b7-5f2a-5400-9ef6-c2969c2cd85f, identifier: RY75066
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3495a90>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_ae9182321536a83668334a7d70d2f5a3.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_ae9182321536a83668334a7d70d2f5a3.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34dd390>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_2b73540dd04aa6a7e990247e9c5bab02.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_2b73540dd04aa6a7e990247e9c5bab02.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3362350>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_aaec52bfb4204ef7a002c667e432ebd6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_aaec52bfb4204ef7a002c667e432ebd6.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae96732d0>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_efd57052745c78836bd5f6fa09232a81.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_efd57052745c78836bd5f6fa09232a81.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 311297b7-5f2a-5400-9ef6-c2969c2cd85f with identifier: RY75066
2026-03-27 19:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 311297b7-5f2a-5400-9ef6-c2969c2cd85f with identifier: RY75066
2026-03-27 19:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 311297b7-5f2a-5400-9ef6-c2969c2cd85f with identifier: RY75066 to the API
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_d90f8470b1a21ade4a3309a9462c84d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:30:24Z',
 'fuel_type': 'diesel',
 'id': '311297b7-5f2a-5400-9ef6-c2969c2cd85f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'V948KS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY75066',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 105326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_92da10f8e9190b2a919848eee85911ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_cc404e59c0442826bf6a8ce492d5aab3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_036a3a2816ba79e19f50d455b9bb5c5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_c6125b631f50ece6fccb6122aad72024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_545747e1421dfc091b4f47a290fb6ba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_aaa96b5f91d1ad001dfcafafb56b7954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_cf99603abf5f53b100605732ed3f2b67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_287895078530805347db18ef1c0fec12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_d90f8470b1a21ade4a3309a9462c84d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311297b7-5f2a-5400-9ef6-c2969c2cd85f/311297b7-5f2a-5400-9ef6-c2969c2cd85f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/59/b259b3e436816f887c63b1e74eda9062/pa/RY75066_271dc06c513afc6167e7b1726b822637.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Expert 1.6 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2018}
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-27 19:12:16 [auto1.nl] INFO: Saving data for RY75066: {'created_time': 1774638736.800266, 'last_price_update_time': 1774638736.800279, 'auction_closing_time': 1774715424.0}
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY75066') HTTP/1.1" 204 0
2026-03-27 19:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_ed9dba80b56bfe747e18054789c8fbe0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_c5c99ef96346167526d73dcfef756b4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_76389d47ab6261716aa7842ba487f4fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34d28d0>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_96384c31e6b7a2096c448bb226a5c9b3.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_96384c31e6b7a2096c448bb226a5c9b3.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae297c3d0>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_95b52515556a1d5be560d37f5ed25483.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_95b52515556a1d5be560d37f5ed25483.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33390d0>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_4773e456ca069c17a28dfaedbc4dade6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_4773e456ca069c17a28dfaedbc4dade6.jpg saved to cache
2026-03-27 19:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_601cabf827c92331fa3dad2085ba1079.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33599d0>
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_ed9dba80b56bfe747e18054789c8fbe0.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_ed9dba80b56bfe747e18054789c8fbe0.jpg saved to cache
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2968490>
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F46%252F16468133c7d9df609682414ea42aa2c0%252Fpa%252FEL29526_c5c99ef96346167526d73dcfef756b4a.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_c5c99ef96346167526d73dcfef756b4a.jpg saved to cache
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0
2026-03-27 19:12:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0, skipping ID generation
2026-03-27 19:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with scrape type 1
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 sending to next pipeline
2026-03-27 19:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0, identifier: EL29526
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3484210>
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_76389d47ab6261716aa7842ba487f4fe.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_76389d47ab6261716aa7842ba487f4fe.jpg saved to cache
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with identifier: EL29526
2026-03-27 19:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with identifier: EL29526
2026-03-27 19:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with identifier: EL29526 to the API
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_c5c99ef96346167526d73dcfef756b4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:29:27Z',
 'fuel_type': 'petrol',
 'id': '7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '87HXG8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL29526',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 278899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_c5c99ef96346167526d73dcfef756b4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_a1edac3bb86e7cf0a379414dc5c1dbc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_95b52515556a1d5be560d37f5ed25483.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_2b73540dd04aa6a7e990247e9c5bab02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_ae9182321536a83668334a7d70d2f5a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0/7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/46/16468133c7d9df609682414ea42aa2c0/pa/EL29526_436b7908a65daf475c08e915a2525645.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V50 1.8 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2009}
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-27 19:12:17 [auto1.nl] INFO: Saving data for EL29526: {'created_time': 1774638737.492752, 'last_price_update_time': 1774638737.492761, 'auction_closing_time': 1774715367.0}
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EL29526') HTTP/1.1" 204 0
2026-03-27 19:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_2bb6eaa11c68b7aa9780351368f0f877.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3296790>
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fa5%252F7aa5b076b88452264c0b38882fdea299%252Fpa%252FUR99157_601cabf827c92331fa3dad2085ba1079.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_601cabf827c92331fa3dad2085ba1079.jpg saved to cache
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3
2026-03-27 19:12:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93ae1b95-53f2-5f14-81ad-40956a1b60a3, skipping ID generation
2026-03-27 19:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with scrape type 1
2026-03-27 19:12:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3 sending to next pipeline
2026-03-27 19:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 93ae1b95-53f2-5f14-81ad-40956a1b60a3, identifier: UR99157
2026-03-27 19:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with identifier: UR99157
2026-03-27 19:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with identifier: UR99157
2026-03-27 19:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with identifier: UR99157 to the API
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_601cabf827c92331fa3dad2085ba1079.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:38:44Z',
 'fuel_type': 'petrol',
 'id': '93ae1b95-53f2-5f14-81ad-40956a1b60a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P041pf',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR99157',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 85811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_f04374a475c963c7a54d6964770394ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_601cabf827c92331fa3dad2085ba1079.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_76389d47ab6261716aa7842ba487f4fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_cf459eda815bdc2adf2ce982348de105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_ed9dba80b56bfe747e18054789c8fbe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_4773e456ca069c17a28dfaedbc4dade6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_96384c31e6b7a2096c448bb226a5c9b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_efd57052745c78836bd5f6fa09232a81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_fac09edf080cc735821f98a4d7545c09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ae1b95-53f2-5f14-81ad-40956a1b60a3/93ae1b95-53f2-5f14-81ad-40956a1b60a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/a5/7aa5b076b88452264c0b38882fdea299/pa/UR99157_aaec52bfb4204ef7a002c667e432ebd6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Motion",
 'transmission': 'manual',
 'trim': 'Motion',
 'year': 2022}
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-27 19:12:17 [auto1.nl] INFO: Saving data for UR99157: {'created_time': 1774638737.977021, 'last_price_update_time': 1774638737.97703, 'auction_closing_time': 1774715924.0}
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UR99157') HTTP/1.1" 204 0
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3465b90>
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F8f%252F158f7049bdc3b122528bea01c6ea9ae2%252Fpa%252FNA39376_2bb6eaa11c68b7aa9780351368f0f877.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_2bb6eaa11c68b7aa9780351368f0f877.jpg saved to cache
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 551244a0-76b8-5bfe-b60f-ac1146539bc4
2026-03-27 19:12:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 551244a0-76b8-5bfe-b60f-ac1146539bc4, skipping ID generation
2026-03-27 19:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 551244a0-76b8-5bfe-b60f-ac1146539bc4 with scrape type 1
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 551244a0-76b8-5bfe-b60f-ac1146539bc4 sending to next pipeline
2026-03-27 19:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 551244a0-76b8-5bfe-b60f-ac1146539bc4, identifier: NA39376
2026-03-27 19:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 551244a0-76b8-5bfe-b60f-ac1146539bc4 with identifier: NA39376
2026-03-27 19:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 551244a0-76b8-5bfe-b60f-ac1146539bc4 with identifier: NA39376
2026-03-27 19:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 551244a0-76b8-5bfe-b60f-ac1146539bc4 with identifier: NA39376 to the API
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_2bb6eaa11c68b7aa9780351368f0f877.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:57:06Z',
 'fuel_type': 'diesel',
 'id': '551244a0-76b8-5bfe-b60f-ac1146539bc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XD734P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA39376',
 'listing': 'auction',
 'location': 'NL, Leeuwarden',
 'make': 'BMW',
 'model': '3er',
 'odometer': 271610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_2bb6eaa11c68b7aa9780351368f0f877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_dcf5c6afa22792ad36bc6f8b726cf519.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_1327bddf48f3830e6c4159e34459b946.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_f91b37217c59cf21ffdd6d3765032dc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551244a0-76b8-5bfe-b60f-ac1146539bc4/551244a0-76b8-5bfe-b60f-ac1146539bc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/8f/158f7049bdc3b122528bea01c6ea9ae2/pa/NA39376_28ab928c9779a72dab09ac8602b6be76.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA39376%27 HTTP/1.1" 200 None
2026-03-27 19:12:18 [auto1.nl] INFO: Saving data for NA39376: {'created_time': 1774638738.414927, 'last_price_update_time': 1774638738.414937, 'auction_closing_time': 1774717026.0}
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NA39376') HTTP/1.1" 204 0
2026-03-27 19:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB11708> (referer: https://www.auto1.com/v1/car-details-view/DB11708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_e3c99adf95fd4c0002dd33ce2a2e39bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_5ee756b97cdefeeec933defc8abf5e72.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_e67343a61e1660d5b8c236bd09568cd7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_7ce9f4004c768ad8f73cb98e689462bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_d5a34ffa702f821e8faeb27baea203f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_0c6470836146c8298125b09cd060e684.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_306a4a803fd70cbd3e7bc3252989d512.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_391c2d8f87006729bb03d12d688de762.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5b5f078-b143-53f1-b3db-e9c7206952ad with identifier: DB11708
2026-03-27 19:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b5f078-b143-53f1-b3db-e9c7206952ad with scrape type 1
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_ed358a2f7ea54b70d545f2170fe1c086.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_ed358a2f7ea54b70d545f2170fe1c086.jpg not downloaded yet
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_d8cb7b146e3dfa33bcba7c8b3310ec89.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_d8cb7b146e3dfa33bcba7c8b3310ec89.jpg not downloaded yet
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_cf289b16ab57f1144d25fe4cda716ddd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_cf289b16ab57f1144d25fe4cda716ddd.jpg not downloaded yet
2026-03-27 19:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae337e550>
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_e3c99adf95fd4c0002dd33ce2a2e39bc.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_e3c99adf95fd4c0002dd33ce2a2e39bc.jpg saved to cache
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3204f50>
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_5ee756b97cdefeeec933defc8abf5e72.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_5ee756b97cdefeeec933defc8abf5e72.jpg saved to cache
2026-03-27 19:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32c1790>
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F03%252Fc8034fd03c560e2434162ce8b67bd734%252Fpa%252FLR65933_e67343a61e1660d5b8c236bd09568cd7.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_e67343a61e1660d5b8c236bd09568cd7.jpg saved to cache
2026-03-27 19:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9
2026-03-27 19:12:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9, skipping ID generation
2026-03-27 19:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9 with scrape type 1
2026-03-27 19:12:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9 sending to next pipeline
2026-03-27 19:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9, identifier: LR65933
2026-03-27 19:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9 with identifier: LR65933
2026-03-27 19:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:12:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-27 19:12:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9 with identifier: LR65933
2026-03-27 19:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 52d11088-e7f0-52c1-bdd0-44c1aeaf50a9 with identifier: LR65933 to the API
2026-03-27 19:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_e67343a61e1660d5b8c236bd09568cd7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:39:01Z',
 'fuel_type': 'electro',
 'id': '52d11088-e7f0-52c1-bdd0-44c1aeaf50a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KK646V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR65933',
 'listing': 'auction',
 'location': 'NL, Hoofddorp',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 120545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2558165,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_e67343a61e1660d5b8c236bd09568cd7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_4fcdabdda2af0452c051b46747a260c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2335667,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_5ee756b97cdefeeec933defc8abf5e72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2310596,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_9a884cd2349424787bdf72e00fb84e98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_037c6ddbdbeb9e0e819d4f274a2ea878.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506129,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_d050516fc9ae452381e9194f5397e7e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2454059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_e3c99adf95fd4c0002dd33ce2a2e39bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545771,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_10b68fe123172ab682d3a5d71d6608a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2401713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_7d7063e0f6356a403f4f41675b7f8f8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d11088-e7f0-52c1-bdd0-44c1aeaf50a9/52d11088-e7f0-52c1-bdd0-44c1aeaf50a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2952898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/03/c8034fd03c560e2434162ce8b67bd734/pa/LR65933_ed1ee642477e5e6d480e114bdad8009f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII electric drive 85 kW 85kW E-Golf',
 'transmission': 'automatic',
 'trim': '85kW E-Golf',
 'year': 2016}
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR65933%27 HTTP/1.1" 200 None
2026-03-27 19:12:20 [auto1.nl] INFO: Saving data for LR65933: {'created_time': 1774638740.061962, 'last_price_update_time': 1774638740.061974, 'auction_closing_time': 1774715941.0}
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LR65933') HTTP/1.1" 204 0
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_390e0061e68311a081fb5ede14f30882.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_390e0061e68311a081fb5ede14f30882.jpg not downloaded yet
2026-03-27 19:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29e2a50>
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_7ce9f4004c768ad8f73cb98e689462bc.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_7ce9f4004c768ad8f73cb98e689462bc.jpg saved to cache
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae281c8d0>
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_d5a34ffa702f821e8faeb27baea203f7.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_d5a34ffa702f821e8faeb27baea203f7.jpg saved to cache
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae291c810>
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_0c6470836146c8298125b09cd060e684.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_0c6470836146c8298125b09cd060e684.jpg saved to cache
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2945e50>
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb5%252F63b5c4c3218e8d46baba1f7ea406dc32%252Fpa%252FAM07460_306a4a803fd70cbd3e7bc3252989d512.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_306a4a803fd70cbd3e7bc3252989d512.jpg saved to cache
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a26724a-46c7-5622-a89f-1089014ba93b
2026-03-27 19:12:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a26724a-46c7-5622-a89f-1089014ba93b, skipping ID generation
2026-03-27 19:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a26724a-46c7-5622-a89f-1089014ba93b with scrape type 1
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a26724a-46c7-5622-a89f-1089014ba93b sending to next pipeline
2026-03-27 19:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5a26724a-46c7-5622-a89f-1089014ba93b, identifier: AM07460
2026-03-27 19:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae341c610>
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_391c2d8f87006729bb03d12d688de762.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_391c2d8f87006729bb03d12d688de762.jpg saved to cache
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_744ae8acba74df6e2fc4afcd50eda85b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_744ae8acba74df6e2fc4afcd50eda85b.jpg not downloaded yet
2026-03-27 19:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5a26724a-46c7-5622-a89f-1089014ba93b with identifier: AM07460
2026-03-27 19:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5a26724a-46c7-5622-a89f-1089014ba93b with identifier: AM07460
2026-03-27 19:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5a26724a-46c7-5622-a89f-1089014ba93b with identifier: AM07460 to the API
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_306a4a803fd70cbd3e7bc3252989d512.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 50,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:11:36Z',
 'fuel_type': 'hybrid',
 'id': '5a26724a-46c7-5622-a89f-1089014ba93b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'Z867NZ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM07460',
 'listing': 'auction',
 'location': 'NL, Alkmaar',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 88621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2692657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_55d2c74be24a39b35545110f10c6a095.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_5a5723131f01f1ef157034bdd309b952.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2451060,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_b61c2e4ad6af50026d3b05c0263767fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521570,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_5464f0f5fa58e6f881b0f3b8f740238b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_763316361976e1a72f10c97a0c18e657.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2186632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_cb680b16aa493e8f7cd978fb9765c57a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2128577,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_0c6470836146c8298125b09cd060e684.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2153864,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_d5a34ffa702f821e8faeb27baea203f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_7ce9f4004c768ad8f73cb98e689462bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a26724a-46c7-5622-a89f-1089014ba93b/5a26724a-46c7-5622-a89f-1089014ba93b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500642,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b5/63b5c4c3218e8d46baba1f7ea406dc32/pa/AM07460_306a4a803fd70cbd3e7bc3252989d512.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-27 19:12:21 [auto1.nl] INFO: Saving data for AM07460: {'created_time': 1774638741.236711, 'last_price_update_time': 1774638741.236721, 'auction_closing_time': 1774714296.0}
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AM07460') HTTP/1.1" 204 0
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_5da3394644a29060977a9176961ab5bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_5da3394644a29060977a9176961ab5bd.jpg not downloaded yet
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_0ab1652b7ac2324670f41dadc2d9acf5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_0ab1652b7ac2324670f41dadc2d9acf5.jpg not downloaded yet
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_430c71e50099abbf5bb9704912633091.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_430c71e50099abbf5bb9704912633091.jpg not downloaded yet
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_f03a5c53560487ef0120c15c6f9dcb2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_f03a5c53560487ef0120c15c6f9dcb2d.jpg not downloaded yet
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_6c42e90f20a21f699d2181cd407915e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_6c42e90f20a21f699d2181cd407915e2.jpg not downloaded yet
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_17e645f4dfff0067f77c6d3fd9656ed6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_044cbca22fadf1e77a5e3de75cbbd843.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_e1e7f5a9c6355816f9a916141607f814.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_ed53d2bd2e5d25a577d3ca88da072d39.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_e108b1deb12b87706b421302dbd9b27a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_21d4d20351fb0cb8977f7218c974195c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_6640a86c7a4ef22165a4be2d3ef19869.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_8b8112562a37d668921d96f69dfce3c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32a36d0>
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_17e645f4dfff0067f77c6d3fd9656ed6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_17e645f4dfff0067f77c6d3fd9656ed6.jpg saved to cache
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ87293> (referer: https://www.auto1.com/v1/car-details-view/SZ87293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN05115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34e2210>
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_044cbca22fadf1e77a5e3de75cbbd843.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_044cbca22fadf1e77a5e3de75cbbd843.jpg saved to cache
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae357f390>
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_e1e7f5a9c6355816f9a916141607f814.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_e1e7f5a9c6355816f9a916141607f814.jpg saved to cache
2026-03-27 19:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29e5d90>
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_ed53d2bd2e5d25a577d3ca88da072d39.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_ed53d2bd2e5d25a577d3ca88da072d39.jpg saved to cache
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae357d050>
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_e108b1deb12b87706b421302dbd9b27a.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_e108b1deb12b87706b421302dbd9b27a.jpg saved to cache
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b9b10>
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_21d4d20351fb0cb8977f7218c974195c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_21d4d20351fb0cb8977f7218c974195c.jpg saved to cache
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae357c750>
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_6640a86c7a4ef22165a4be2d3ef19869.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_6640a86c7a4ef22165a4be2d3ef19869.jpg saved to cache
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae357d190>
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fd6%252F38d6964ccb84b703111348a9cc04a31a%252Fpa%252FCM00428_8b8112562a37d668921d96f69dfce3c9.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_8b8112562a37d668921d96f69dfce3c9.jpg saved to cache
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbaa6dcc-244c-5a8b-8537-0b65678867ce
2026-03-27 19:12:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbaa6dcc-244c-5a8b-8537-0b65678867ce, skipping ID generation
2026-03-27 19:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbaa6dcc-244c-5a8b-8537-0b65678867ce with scrape type 1
2026-03-27 19:12:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbaa6dcc-244c-5a8b-8537-0b65678867ce sending to next pipeline
2026-03-27 19:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fbaa6dcc-244c-5a8b-8537-0b65678867ce, identifier: CM00428
2026-03-27 19:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fbaa6dcc-244c-5a8b-8537-0b65678867ce with identifier: CM00428
2026-03-27 19:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fbaa6dcc-244c-5a8b-8537-0b65678867ce with identifier: CM00428
2026-03-27 19:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fbaa6dcc-244c-5a8b-8537-0b65678867ce with identifier: CM00428 to the API
2026-03-27 19:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_8b8112562a37d668921d96f69dfce3c9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:41:55Z',
 'fuel_type': 'petrol',
 'id': 'fbaa6dcc-244c-5a8b-8537-0b65678867ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'Kz520z',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM00428',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 89052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597195,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_044cbca22fadf1e77a5e3de75cbbd843.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537561,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_e108b1deb12b87706b421302dbd9b27a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2772316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_8b8112562a37d668921d96f69dfce3c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741291,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_ed53d2bd2e5d25a577d3ca88da072d39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2485947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_17e645f4dfff0067f77c6d3fd9656ed6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2760909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_6640a86c7a4ef22165a4be2d3ef19869.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2706522,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_e1e7f5a9c6355816f9a916141607f814.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794153,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_21d4d20351fb0cb8977f7218c974195c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_391c2d8f87006729bb03d12d688de762.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbaa6dcc-244c-5a8b-8537-0b65678867ce/fbaa6dcc-244c-5a8b-8537-0b65678867ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2756543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/d6/38d6964ccb84b703111348a9cc04a31a/pa/CM00428_4ba161b36ba924a449605f672c3cdb01.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up! BlueMotion',
 'transmission': 'manual',
 'trim': 'Move  BlueMotion',
 'year': 2017}
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-27 19:12:23 [auto1.nl] INFO: Saving data for CM00428: {'created_time': 1774638743.219328, 'last_price_update_time': 1774638743.219343, 'auction_closing_time': 1774716115.0}
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CM00428') HTTP/1.1" 204 0
2026-03-27 19:12:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with identifier: SZ87293
2026-03-27 19:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with scrape type 1
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff7%252F4ff70c8288640d7be355b37130893d64%252Fpa%252FSZ87293_1ba934a5924b255895c2772579e8c981.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_1ba934a5924b255895c2772579e8c981.jpg not downloaded yet
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff7%252F4ff70c8288640d7be355b37130893d64%252Fpa%252FSZ87293_351f0996e294622274af9a0077824d48.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_351f0996e294622274af9a0077824d48.jpg not downloaded yet
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff7%252F4ff70c8288640d7be355b37130893d64%252Fpa%252FSZ87293_57b3f9331d4c66b885c2f3f0ebf61935.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_57b3f9331d4c66b885c2f3f0ebf61935.jpg not downloaded yet
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff7%252F4ff70c8288640d7be355b37130893d64%252Fpa%252FSZ87293_8e6e8585638e0beafc397e759184b6fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_8e6e8585638e0beafc397e759184b6fd.jpg not downloaded yet
2026-03-27 19:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_f04d160a7faa055578c54688e4f07c2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_744ae8acba74df6e2fc4afcd50eda85b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_ed358a2f7ea54b70d545f2170fe1c086.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_cf289b16ab57f1144d25fe4cda716ddd.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_d8cb7b146e3dfa33bcba7c8b3310ec89.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_390e0061e68311a081fb5ede14f30882.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_a013ab09e0ad60339bdee1f58593add0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b9b10>
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_f04d160a7faa055578c54688e4f07c2e.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_f04d160a7faa055578c54688e4f07c2e.jpg saved to cache
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33af750>
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_744ae8acba74df6e2fc4afcd50eda85b.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_744ae8acba74df6e2fc4afcd50eda85b.jpg saved to cache
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae281aa50>
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_ed358a2f7ea54b70d545f2170fe1c086.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_ed358a2f7ea54b70d545f2170fe1c086.jpg saved to cache
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33ac1d0>
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_cf289b16ab57f1144d25fe4cda716ddd.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_cf289b16ab57f1144d25fe4cda716ddd.jpg saved to cache
2026-03-27 19:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33ba850>
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_d8cb7b146e3dfa33bcba7c8b3310ec89.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_d8cb7b146e3dfa33bcba7c8b3310ec89.jpg saved to cache
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2832610>
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_390e0061e68311a081fb5ede14f30882.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_390e0061e68311a081fb5ede14f30882.jpg saved to cache
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2833150>
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_a013ab09e0ad60339bdee1f58593add0.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_a013ab09e0ad60339bdee1f58593add0.jpg saved to cache
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034
2026-03-27 19:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK48987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX76865/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_f03a5c53560487ef0120c15c6f9dcb2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_6c42e90f20a21f699d2181cd407915e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_0ab1652b7ac2324670f41dadc2d9acf5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_93590263da207123a490a28f45d61e0d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_5da3394644a29060977a9176961ab5bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_430c71e50099abbf5bb9704912633091.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_57b3f9331d4c66b885c2f3f0ebf61935.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_81f19e122dbd5242d5e45929d0c8b2e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_1ba934a5924b255895c2772579e8c981.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_8e6e8585638e0beafc397e759184b6fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_78a16dc20a7f1b215c07a4e9604fa80c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_351f0996e294622274af9a0077824d48.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9731950>
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_f03a5c53560487ef0120c15c6f9dcb2d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_f03a5c53560487ef0120c15c6f9dcb2d.jpg saved to cache
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2816150>
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_6c42e90f20a21f699d2181cd407915e2.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_6c42e90f20a21f699d2181cd407915e2.jpg saved to cache
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3312150>
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_0ab1652b7ac2324670f41dadc2d9acf5.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_0ab1652b7ac2324670f41dadc2d9acf5.jpg saved to cache
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae28536d0>
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fff%252F0cffd5bd6461520ece60cfb03646f0f2%252Fpa%252FHL89699_93590263da207123a490a28f45d61e0d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_93590263da207123a490a28f45d61e0d.jpg saved to cache
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a89fa08-1f66-5a03-ba92-e05181666266
2026-03-27 19:12:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a89fa08-1f66-5a03-ba92-e05181666266, skipping ID generation
2026-03-27 19:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a89fa08-1f66-5a03-ba92-e05181666266 with scrape type 1
2026-03-27 19:12:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a89fa08-1f66-5a03-ba92-e05181666266 sending to next pipeline
2026-03-27 19:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6a89fa08-1f66-5a03-ba92-e05181666266, identifier: HL89699
2026-03-27 19:12:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3495750>
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_5da3394644a29060977a9176961ab5bd.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_5da3394644a29060977a9176961ab5bd.jpg saved to cache
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33b9010>
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fac%252Fcfac6565c509f228da46b4a6cb561f35%252Fpa%252FDB11708_430c71e50099abbf5bb9704912633091.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_430c71e50099abbf5bb9704912633091.jpg saved to cache
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5b5f078-b143-53f1-b3db-e9c7206952ad
2026-03-27 19:12:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5b5f078-b143-53f1-b3db-e9c7206952ad, skipping ID generation
2026-03-27 19:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b5f078-b143-53f1-b3db-e9c7206952ad with scrape type 1
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5b5f078-b143-53f1-b3db-e9c7206952ad sending to next pipeline
2026-03-27 19:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c5b5f078-b143-53f1-b3db-e9c7206952ad, identifier: DB11708
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3357050>
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f88dc51c-6ee0-5b82-8de8-223c90bcdf7e/f88dc51c-6ee0-5b82-8de8-223c90bcdf7e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff7%252F4ff70c8288640d7be355b37130893d64%252Fpa%252FSZ87293_57b3f9331d4c66b885c2f3f0ebf61935.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_57b3f9331d4c66b885c2f3f0ebf61935.jpg saved to cache
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2811f90>
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F7f%252F657febba65c7e6c16c6483b782246b89%252Fpa%252FBY94157_81f19e122dbd5242d5e45929d0c8b2e1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_81f19e122dbd5242d5e45929d0c8b2e1.jpg saved to cache
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034
2026-03-27 19:12:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034, skipping ID generation
2026-03-27 19:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with scrape type 1
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 sending to next pipeline
2026-03-27 19:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034, identifier: BY94157
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faaea03ba10>
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f88dc51c-6ee0-5b82-8de8-223c90bcdf7e/f88dc51c-6ee0-5b82-8de8-223c90bcdf7e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff7%252F4ff70c8288640d7be355b37130893d64%252Fpa%252FSZ87293_1ba934a5924b255895c2772579e8c981.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_1ba934a5924b255895c2772579e8c981.jpg saved to cache
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33baa50>
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f88dc51c-6ee0-5b82-8de8-223c90bcdf7e/f88dc51c-6ee0-5b82-8de8-223c90bcdf7e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff7%252F4ff70c8288640d7be355b37130893d64%252Fpa%252FSZ87293_8e6e8585638e0beafc397e759184b6fd.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_8e6e8585638e0beafc397e759184b6fd.jpg saved to cache
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2966810>
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cc57e7-24d1-55b6-a939-72e59a9813d1/f8cc57e7-24d1-55b6-a939-72e59a9813d1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F16%252F9c16b8eaffc4aed9b77b72633d34a739%252Fpa%252FUY18740_78a16dc20a7f1b215c07a4e9604fa80c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_78a16dc20a7f1b215c07a4e9604fa80c.jpg saved to cache
2026-03-27 19:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8cc57e7-24d1-55b6-a939-72e59a9813d1
2026-03-27 19:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6a89fa08-1f66-5a03-ba92-e05181666266 with identifier: HL89699
2026-03-27 19:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6a89fa08-1f66-5a03-ba92-e05181666266 with identifier: HL89699
2026-03-27 19:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6a89fa08-1f66-5a03-ba92-e05181666266 with identifier: HL89699 to the API
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_93590263da207123a490a28f45d61e0d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:55:17Z',
 'fuel_type': 'hybrid',
 'id': '6a89fa08-1f66-5a03-ba92-e05181666266',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JL066K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL89699',
 'listing': 'auction',
 'location': 'NL, Leiderdorp',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 85780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2076156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_93590263da207123a490a28f45d61e0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1927977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_f04d160a7faa055578c54688e4f07c2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2098850,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_99beaf5b4c9b14841770a85044586d26.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1844499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_53c1305d057aedd764889d7d50a0c98f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2056816,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_cfbcbb72b31c02162172f89e12e87d5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2200470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_08dbaac1ef68715c85df092aaf6d3601.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1949749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_b42b7459216a4eb8bbb44026de715fc6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_7867c8c97317d9ef8c2166fdd309e369.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2046221,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_21f139d72c55b89e02334447accbae0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a89fa08-1f66-5a03-ba92-e05181666266/6a89fa08-1f66-5a03-ba92-e05181666266_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2268876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/ff/0cffd5bd6461520ece60cfb03646f0f2/pa/HL89699_fcf9a0fb40631b90863b1f04e9f36d45.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2013}
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL89699%27 HTTP/1.1" 200 None
2026-03-27 19:12:25 [auto1.nl] INFO: Saving data for HL89699: {'created_time': 1774638745.989126, 'last_price_update_time': 1774638745.989136, 'auction_closing_time': 1774716917.0}
2026-03-27 19:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HL89699') HTTP/1.1" 204 0
2026-03-27 19:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c5b5f078-b143-53f1-b3db-e9c7206952ad with identifier: DB11708
2026-03-27 19:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c5b5f078-b143-53f1-b3db-e9c7206952ad with identifier: DB11708
2026-03-27 19:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c5b5f078-b143-53f1-b3db-e9c7206952ad with identifier: DB11708 to the API
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_430c71e50099abbf5bb9704912633091.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:28:44Z',
 'fuel_type': 'diesel',
 'id': 'c5b5f078-b143-53f1-b3db-e9c7206952ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R824PJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB11708',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 248911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2199932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_ed358a2f7ea54b70d545f2170fe1c086.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2159131,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_d8cb7b146e3dfa33bcba7c8b3310ec89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2251133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_cf289b16ab57f1144d25fe4cda716ddd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2156964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_390e0061e68311a081fb5ede14f30882.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2154497,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_744ae8acba74df6e2fc4afcd50eda85b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2240135,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_5da3394644a29060977a9176961ab5bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2071954,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_0ab1652b7ac2324670f41dadc2d9acf5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2147810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_430c71e50099abbf5bb9704912633091.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1997863,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_f03a5c53560487ef0120c15c6f9dcb2d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b5f078-b143-53f1-b3db-e9c7206952ad/c5b5f078-b143-53f1-b3db-e9c7206952ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2193319,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ac/cfac6565c509f228da46b4a6cb561f35/pa/DB11708_6c42e90f20a21f699d2181cd407915e2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2012}
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-27 19:12:26 [auto1.nl] INFO: Saving data for DB11708: {'created_time': 1774638746.317512, 'last_price_update_time': 1774638746.317522, 'auction_closing_time': 1774715324.0}
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DB11708') HTTP/1.1" 204 0
2026-03-27 19:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with identifier: BY94157
2026-03-27 19:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with identifier: BY94157
2026-03-27 19:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with identifier: BY94157 to the API
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_81f19e122dbd5242d5e45929d0c8b2e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:32:53Z',
 'fuel_type': 'diesel',
 'id': '317d27cd-5c43-5cde-9d4e-1b1fdd7da034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '6VBP11',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY94157',
 'listing': 'auction',
 'location': 'NL, Apeldoorn',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 262999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_81f19e122dbd5242d5e45929d0c8b2e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_6c900ba400e8c7d644f8a5729083aae3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_a013ab09e0ad60339bdee1f58593add0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_fbe0e60d1bedbcb97f986ae9b5ec439a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_317d27cd-5c43-5cde-9d4e-1b1fdd7da034/317d27cd-5c43-5cde-9d4e-1b1fdd7da034_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/7f/657febba65c7e6c16c6483b782246b89/pa/BY94157_f5a912353e3f98a7e4670a35d760f650.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Niveau A L1',
 'transmission': 'manual',
 'trim': 'Niveau A L1',
 'year': 2009}
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-27 19:12:26 [auto1.nl] INFO: Saving data for BY94157: {'created_time': 1774638746.640204, 'last_price_update_time': 1774638746.640214, 'auction_closing_time': 1774715573.0}
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY94157') HTTP/1.1" 204 0
2026-03-27 19:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR80776> (referer: https://www.auto1.com/v1/car-details-view/AR80776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35c0e50>
2026-03-27 19:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f88dc51c-6ee0-5b82-8de8-223c90bcdf7e/f88dc51c-6ee0-5b82-8de8-223c90bcdf7e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff7%252F4ff70c8288640d7be355b37130893d64%252Fpa%252FSZ87293_351f0996e294622274af9a0077824d48.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_351f0996e294622274af9a0077824d48.jpg saved to cache
2026-03-27 19:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e
2026-03-27 19:12:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e, skipping ID generation
2026-03-27 19:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with scrape type 1
2026-03-27 19:12:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e sending to next pipeline
2026-03-27 19:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e, identifier: SZ87293
2026-03-27 19:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with identifier: SZ87293
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-27 19:12:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with identifier: SZ87293
2026-03-27 19:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with identifier: SZ87293 to the API
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_351f0996e294622274af9a0077824d48.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:04:50Z',
 'fuel_type': 'petrol',
 'id': 'f88dc51c-6ee0-5b82-8de8-223c90bcdf7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'Z161LD',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ87293',
 'listing': 'auction',
 'location': 'NL, Enschede',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 136694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f88dc51c-6ee0-5b82-8de8-223c90bcdf7e/f88dc51c-6ee0-5b82-8de8-223c90bcdf7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_1ba934a5924b255895c2772579e8c981.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f88dc51c-6ee0-5b82-8de8-223c90bcdf7e/f88dc51c-6ee0-5b82-8de8-223c90bcdf7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_351f0996e294622274af9a0077824d48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f88dc51c-6ee0-5b82-8de8-223c90bcdf7e/f88dc51c-6ee0-5b82-8de8-223c90bcdf7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_57b3f9331d4c66b885c2f3f0ebf61935.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f88dc51c-6ee0-5b82-8de8-223c90bcdf7e/f88dc51c-6ee0-5b82-8de8-223c90bcdf7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f7/4ff70c8288640d7be355b37130893d64/pa/SZ87293_8e6e8585638e0beafc397e759184b6fd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Race',
 'transmission': 'manual',
 'trim': 'Color Race',
 'year': 2010}
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [auto1.nl] INFO: Saving data for SZ87293: {'created_time': 1774638747.288693, 'last_price_update_time': 1774638747.288705, 'auction_closing_time': 1774713890.0}
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SZ87293') HTTP/1.1" 204 0
2026-03-27 19:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD17412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_e6f8b507986e717d72c564eb16a049d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with identifier: AR80776
2026-03-27 19:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with scrape type 1
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4efe0107-92f1-5cfc-bed7-c17f63abcfe5
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_973b57e02e77ce87de9c45d67dfc844f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_973b57e02e77ce87de9c45d67dfc844f.jpg already downloaded
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_5c71b60359140e863e63430af89f7675.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_5c71b60359140e863e63430af89f7675.jpg already downloaded
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_539d02c6ffe60d5a5c85d32c84f28261.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_539d02c6ffe60d5a5c85d32c84f28261.jpg already downloaded
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_9d37662b212bc003ca7c23c507b05862.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_9d37662b212bc003ca7c23c507b05862.jpg already downloaded
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_49561dedc167c73b5eae7998601861de.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_49561dedc167c73b5eae7998601861de.jpg already downloaded
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_e53a1ad69d6bc6e117dd6e5a5f2d5d89.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_e53a1ad69d6bc6e117dd6e5a5f2d5d89.jpg already downloaded
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_6ed6384ad5c1e939349795cd1ffce2a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_6ed6384ad5c1e939349795cd1ffce2a3.jpg already downloaded
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_563bb16c025da2d8b5ad8c8642bf9575.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_563bb16c025da2d8b5ad8c8642bf9575.jpg already downloaded
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_40e2a34b2be05b44e2079f39ae7a48dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_40e2a34b2be05b44e2079f39ae7a48dd.jpg already downloaded
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F51%252F2051d56c4fb4d8f286e0eeaac8826c29%252Fpa%252FAR80776_c3b2f3830e30d47cc4d2b253cfce1f3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_c3b2f3830e30d47cc4d2b253cfce1f3a.jpg already downloaded
2026-03-27 19:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5, identifier: AR80776
2026-03-27 19:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with identifier: AR80776
2026-03-27 19:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with identifier: AR80776
2026-03-27 19:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with identifier: AR80776 to the API
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR80776>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:58:46Z',
 'fuel_type': 'petrol',
 'id': '4efe0107-92f1-5cfc-bed7-c17f63abcfe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZL183T',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR80776',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 111175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_973b57e02e77ce87de9c45d67dfc844f.jpg',
                'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_5c71b60359140e863e63430af89f7675.jpg',
                'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_539d02c6ffe60d5a5c85d32c84f28261.jpg',
                'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_9d37662b212bc003ca7c23c507b05862.jpg',
                'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_49561dedc167c73b5eae7998601861de.jpg',
                'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_e53a1ad69d6bc6e117dd6e5a5f2d5d89.jpg',
                'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_6ed6384ad5c1e939349795cd1ffce2a3.jpg',
                'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_563bb16c025da2d8b5ad8c8642bf9575.jpg',
                'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_40e2a34b2be05b44e2079f39ae7a48dd.jpg',
                'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_c3b2f3830e30d47cc4d2b253cfce1f3a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_973b57e02e77ce87de9c45d67dfc844f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_5c71b60359140e863e63430af89f7675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_539d02c6ffe60d5a5c85d32c84f28261.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_9d37662b212bc003ca7c23c507b05862.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_49561dedc167c73b5eae7998601861de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_e53a1ad69d6bc6e117dd6e5a5f2d5d89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_6ed6384ad5c1e939349795cd1ffce2a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_563bb16c025da2d8b5ad8c8642bf9575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_40e2a34b2be05b44e2079f39ae7a48dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efe0107-92f1-5cfc-bed7-c17f63abcfe5/4efe0107-92f1-5cfc-bed7-c17f63abcfe5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/51/2051d56c4fb4d8f286e0eeaac8826c29/pa/AR80776_c3b2f3830e30d47cc4d2b253cfce1f3a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-27 19:12:27 [auto1.nl] INFO: Saving data for AR80776: {'created_time': 1774638747.883369, 'last_price_update_time': 1774638747.883379, 'auction_closing_time': 1774717126.0}
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AR80776') HTTP/1.1" 204 0
2026-03-27 19:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_e94d3efa8521b3ff5ec1d30aab248180.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP95967/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD36085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN05115> (referer: https://www.auto1.com/v1/car-details-view/GN05115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ05110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2856e50>
2026-03-27 19:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cc57e7-24d1-55b6-a939-72e59a9813d1/f8cc57e7-24d1-55b6-a939-72e59a9813d1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F16%252F9c16b8eaffc4aed9b77b72633d34a739%252Fpa%252FUY18740_e6f8b507986e717d72c564eb16a049d8.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_e6f8b507986e717d72c564eb16a049d8.jpg saved to cache
2026-03-27 19:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8cc57e7-24d1-55b6-a939-72e59a9813d1
2026-03-27 19:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3311390>
2026-03-27 19:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cc57e7-24d1-55b6-a939-72e59a9813d1/f8cc57e7-24d1-55b6-a939-72e59a9813d1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F16%252F9c16b8eaffc4aed9b77b72633d34a739%252Fpa%252FUY18740_e94d3efa8521b3ff5ec1d30aab248180.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_e94d3efa8521b3ff5ec1d30aab248180.jpg saved to cache
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8cc57e7-24d1-55b6-a939-72e59a9813d1
2026-03-27 19:12:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8cc57e7-24d1-55b6-a939-72e59a9813d1, skipping ID generation
2026-03-27 19:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8cc57e7-24d1-55b6-a939-72e59a9813d1 with scrape type 1
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8cc57e7-24d1-55b6-a939-72e59a9813d1 sending to next pipeline
2026-03-27 19:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f8cc57e7-24d1-55b6-a939-72e59a9813d1, identifier: UY18740
2026-03-27 19:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f8cc57e7-24d1-55b6-a939-72e59a9813d1 with identifier: UY18740
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f8cc57e7-24d1-55b6-a939-72e59a9813d1 with identifier: UY18740
2026-03-27 19:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f8cc57e7-24d1-55b6-a939-72e59a9813d1 with identifier: UY18740 to the API
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_e94d3efa8521b3ff5ec1d30aab248180.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:34:10Z',
 'fuel_type': 'petrol',
 'id': 'f8cc57e7-24d1-55b6-a939-72e59a9813d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '23PVKL',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY18740',
 'listing': 'auction',
 'location': 'NL, Enschede',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 176542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cc57e7-24d1-55b6-a939-72e59a9813d1/f8cc57e7-24d1-55b6-a939-72e59a9813d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_e94d3efa8521b3ff5ec1d30aab248180.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cc57e7-24d1-55b6-a939-72e59a9813d1/f8cc57e7-24d1-55b6-a939-72e59a9813d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_e6f8b507986e717d72c564eb16a049d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cc57e7-24d1-55b6-a939-72e59a9813d1/f8cc57e7-24d1-55b6-a939-72e59a9813d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_b91ee39f1b2eb8baeda5f0820a6054a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cc57e7-24d1-55b6-a939-72e59a9813d1/f8cc57e7-24d1-55b6-a939-72e59a9813d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/16/9c16b8eaffc4aed9b77b72633d34a739/pa/UY18740_78a16dc20a7f1b215c07a4e9604fa80c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-12-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 LX',
 'transmission': 'manual',
 'trim': 'LX',
 'year': 2004}
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [auto1.nl] INFO: Saving data for UY18740: {'created_time': 1774638748.630016, 'last_price_update_time': 1774638748.630027, 'auction_closing_time': 1774715650.0}
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY18740') HTTP/1.1" 204 0
2026-03-27 19:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN82428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX76865> (referer: https://www.auto1.com/v1/car-details-view/NX76865/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with identifier: GN05115
2026-03-27 19:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with scrape type 1
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_0b256a9ef5fc3df1945fbbea6b784510.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_0b256a9ef5fc3df1945fbbea6b784510.jpg not downloaded yet
2026-03-27 19:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_b9311541f61870d39fdfca740d07f6c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_b9311541f61870d39fdfca740d07f6c4.jpg not downloaded yet
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_2bca959e96a855c44b42ff34fefc8c86.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_2bca959e96a855c44b42ff34fefc8c86.jpg not downloaded yet
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_b3ea3f8d25adef0ba155f1a8d6d539ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_b3ea3f8d25adef0ba155f1a8d6d539ae.jpg not downloaded yet
2026-03-27 19:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK48987> (referer: https://www.auto1.com/v1/car-details-view/FK48987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_870044c8d8345efb19bc43f6b118511d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_870044c8d8345efb19bc43f6b118511d.jpg not downloaded yet
2026-03-27 19:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_8f38a83c413d51467ce7a64f2f6b5eb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_8f38a83c413d51467ce7a64f2f6b5eb4.jpg not downloaded yet
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_38dd763c9bce8924c7cb2e01d7eef574.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_38dd763c9bce8924c7cb2e01d7eef574.jpg not downloaded yet
2026-03-27 19:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with identifier: NX76865
2026-03-27 19:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with scrape type 1
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item fd91b14e-41e8-5dfc-8bd2-e1eaea44f134
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F03%252F2a03059597aa74505c56e600b7007b47%252Fpa%252FNX76865_e138f0e6ecc136f0af698876d1e1bbc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_e138f0e6ecc136f0af698876d1e1bbc6.jpg already downloaded
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F03%252F2a03059597aa74505c56e600b7007b47%252Fpa%252FNX76865_855cfaefcad635fb51751d7795d4f0d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_855cfaefcad635fb51751d7795d4f0d6.jpg already downloaded
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F03%252F2a03059597aa74505c56e600b7007b47%252Fpa%252FNX76865_47f78224cb119f9947263f6691685933.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_47f78224cb119f9947263f6691685933.jpg already downloaded
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F03%252F2a03059597aa74505c56e600b7007b47%252Fpa%252FNX76865_91f5da2f88e1d82a60722135050b5d03.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_91f5da2f88e1d82a60722135050b5d03.jpg already downloaded
2026-03-27 19:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134, identifier: NX76865
2026-03-27 19:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with identifier: NX76865
2026-03-27 19:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with identifier: NX76865
2026-03-27 19:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with identifier: NX76865 to the API
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NX76865>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:50:43Z',
 'fuel_type': 'diesel',
 'id': 'fd91b14e-41e8-5dfc-8bd2-e1eaea44f134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZV276D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX76865',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 212567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photo_urls': ['https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_e138f0e6ecc136f0af698876d1e1bbc6.jpg',
                'https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_855cfaefcad635fb51751d7795d4f0d6.jpg',
                'https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_47f78224cb119f9947263f6691685933.jpg',
                'https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_91f5da2f88e1d82a60722135050b5d03.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd91b14e-41e8-5dfc-8bd2-e1eaea44f134/fd91b14e-41e8-5dfc-8bd2-e1eaea44f134_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_e138f0e6ecc136f0af698876d1e1bbc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd91b14e-41e8-5dfc-8bd2-e1eaea44f134/fd91b14e-41e8-5dfc-8bd2-e1eaea44f134_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_855cfaefcad635fb51751d7795d4f0d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd91b14e-41e8-5dfc-8bd2-e1eaea44f134/fd91b14e-41e8-5dfc-8bd2-e1eaea44f134_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_47f78224cb119f9947263f6691685933.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd91b14e-41e8-5dfc-8bd2-e1eaea44f134/fd91b14e-41e8-5dfc-8bd2-e1eaea44f134_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/03/2a03059597aa74505c56e600b7007b47/pa/NX76865_91f5da2f88e1d82a60722135050b5d03.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.1 CRDi Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2013}
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-27 19:12:29 [auto1.nl] INFO: Saving data for NX76865: {'created_time': 1774638749.257578, 'last_price_update_time': 1774638749.257588, 'auction_closing_time': 1774716643.0}
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX76865') HTTP/1.1" 204 0
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_bd406371845a43655459d6426932cd70.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_bd406371845a43655459d6426932cd70.jpg not downloaded yet
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_57b15f3e2081d4c794e04b835c6cf2da.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_57b15f3e2081d4c794e04b835c6cf2da.jpg not downloaded yet
2026-03-27 19:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with identifier: FK48987
2026-03-27 19:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with scrape type 1
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_73d1cc00afd655c4dca886c716e5f619.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_73d1cc00afd655c4dca886c716e5f619.jpg not downloaded yet
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_9961f136df0647fa78735c58a5d1dfba.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_9961f136df0647fa78735c58a5d1dfba.jpg not downloaded yet
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_c3d3315eb8baeb5138dc772afa46aa19.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_c3d3315eb8baeb5138dc772afa46aa19.jpg not downloaded yet
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_a0ff53c57aa33caf31cb64985ceffed9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_a0ff53c57aa33caf31cb64985ceffed9.jpg not downloaded yet
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_ed7a22e6dc1fb0a4dec63bf8b9e37c72.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_ed7a22e6dc1fb0a4dec63bf8b9e37c72.jpg not downloaded yet
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_c8973cf57a7f742247e0a88bd8986754.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_c8973cf57a7f742247e0a88bd8986754.jpg not downloaded yet
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_b3ea3f8d25adef0ba155f1a8d6d539ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_0b256a9ef5fc3df1945fbbea6b784510.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR49127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_c8973cf57a7f742247e0a88bd8986754.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_ed7a22e6dc1fb0a4dec63bf8b9e37c72.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35cf050>
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_b3ea3f8d25adef0ba155f1a8d6d539ae.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_b3ea3f8d25adef0ba155f1a8d6d539ae.jpg saved to cache
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_a0ff53c57aa33caf31cb64985ceffed9.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae357a650>
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_0b256a9ef5fc3df1945fbbea6b784510.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_0b256a9ef5fc3df1945fbbea6b784510.jpg saved to cache
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_c3d3315eb8baeb5138dc772afa46aa19.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL63517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR15886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34ab250>
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_c8973cf57a7f742247e0a88bd8986754.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_c8973cf57a7f742247e0a88bd8986754.jpg saved to cache
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3556e10>
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_ed7a22e6dc1fb0a4dec63bf8b9e37c72.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_ed7a22e6dc1fb0a4dec63bf8b9e37c72.jpg saved to cache
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN23461> (referer: https://www.auto1.com/v1/car-details-view/BN23461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB31523> (referer: https://www.auto1.com/v1/car-details-view/FB31523/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae343b550>
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_a0ff53c57aa33caf31cb64985ceffed9.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_a0ff53c57aa33caf31cb64985ceffed9.jpg saved to cache
2026-03-27 19:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be
2026-03-27 19:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_73d1cc00afd655c4dca886c716e5f619.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3348050>
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_c3d3315eb8baeb5138dc772afa46aa19.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_c3d3315eb8baeb5138dc772afa46aa19.jpg saved to cache
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be
2026-03-27 19:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7694ef7-c492-5d5f-ad06-16544646ad0e with identifier: BN23461
2026-03-27 19:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7694ef7-c492-5d5f-ad06-16544646ad0e with scrape type 1
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7694ef7-c492-5d5f-ad06-16544646ad0e
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_37ffdc14e530f32ce65594e8f059ea79.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_37ffdc14e530f32ce65594e8f059ea79.jpg already downloaded
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_f81f5a6bc7f9534dd954439ae0257a73.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_f81f5a6bc7f9534dd954439ae0257a73.jpg already downloaded
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_df1c04ceecdd248c0cbcfee83e14ceee.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_df1c04ceecdd248c0cbcfee83e14ceee.jpg already downloaded
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_65a0e6897055a0bd722a780748bf52b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_65a0e6897055a0bd722a780748bf52b5.jpg already downloaded
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_e2cc33cfdc9a0180638f19bc81acb5de.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_e2cc33cfdc9a0180638f19bc81acb5de.jpg already downloaded
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_049105d53e18b639ed364772335b2a07.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_049105d53e18b639ed364772335b2a07.jpg already downloaded
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_7f686be8adc6fed85a6c894fbd3bd07d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_7f686be8adc6fed85a6c894fbd3bd07d.jpg already downloaded
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_53a5d9cad519dbf64928039b1fd00fde.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_53a5d9cad519dbf64928039b1fd00fde.jpg already downloaded
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_f7c3ddc5708c03adfb53bb231175deeb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_f7c3ddc5708c03adfb53bb231175deeb.jpg already downloaded
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fda%252Ff5daf456fc3514400b02452f670ae4f7%252Fpa%252FBN23461_7792fdabd94e1c878f9e742f737256ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_7792fdabd94e1c878f9e742f737256ee.jpg already downloaded
2026-03-27 19:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7694ef7-c492-5d5f-ad06-16544646ad0e, identifier: BN23461
2026-03-27 19:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7694ef7-c492-5d5f-ad06-16544646ad0e with identifier: BN23461
2026-03-27 19:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7694ef7-c492-5d5f-ad06-16544646ad0e with identifier: BN23461
2026-03-27 19:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7694ef7-c492-5d5f-ad06-16544646ad0e with identifier: BN23461 to the API
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BN23461>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:57:38Z',
 'fuel_type': 'petrol',
 'id': 'e7694ef7-c492-5d5f-ad06-16544646ad0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '35ZVN5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN23461',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 476959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_37ffdc14e530f32ce65594e8f059ea79.jpg',
                'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_f81f5a6bc7f9534dd954439ae0257a73.jpg',
                'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_df1c04ceecdd248c0cbcfee83e14ceee.jpg',
                'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_65a0e6897055a0bd722a780748bf52b5.jpg',
                'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_e2cc33cfdc9a0180638f19bc81acb5de.jpg',
                'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_049105d53e18b639ed364772335b2a07.jpg',
                'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_7f686be8adc6fed85a6c894fbd3bd07d.jpg',
                'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_53a5d9cad519dbf64928039b1fd00fde.jpg',
                'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_f7c3ddc5708c03adfb53bb231175deeb.jpg',
                'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_7792fdabd94e1c878f9e742f737256ee.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_37ffdc14e530f32ce65594e8f059ea79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_f81f5a6bc7f9534dd954439ae0257a73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2558498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_df1c04ceecdd248c0cbcfee83e14ceee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_65a0e6897055a0bd722a780748bf52b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2403083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_e2cc33cfdc9a0180638f19bc81acb5de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_049105d53e18b639ed364772335b2a07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_7f686be8adc6fed85a6c894fbd3bd07d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2688965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_53a5d9cad519dbf64928039b1fd00fde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_f7c3ddc5708c03adfb53bb231175deeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7694ef7-c492-5d5f-ad06-16544646ad0e/e7694ef7-c492-5d5f-ad06-16544646ad0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/da/f5daf456fc3514400b02452f670ae4f7/pa/BN23461_7792fdabd94e1c878f9e742f737256ee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [auto1.nl] INFO: Saving data for BN23461: {'created_time': 1774638750.590244, 'last_price_update_time': 1774638750.590254, 'auction_closing_time': 1774717058.0}
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN23461') HTTP/1.1" 204 0
2026-03-27 19:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21982b56-1d48-59a4-94bd-0f25f4ca92f1 with identifier: FB31523
2026-03-27 19:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1 with scrape type 1
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_a4862cbbfae85bb00b8068321147ea67.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_a4862cbbfae85bb00b8068321147ea67.jpg not downloaded yet
2026-03-27 19:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC58225/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU12203/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_a64149530d66da1c3b706015c96156f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_a64149530d66da1c3b706015c96156f5.jpg not downloaded yet
2026-03-27 19:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2944450>
2026-03-27 19:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F49%252F59493bf9afa21e11fba7104c63f53cf4%252Fpa%252FFK48987_73d1cc00afd655c4dca886c716e5f619.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_73d1cc00afd655c4dca886c716e5f619.jpg saved to cache
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be
2026-03-27 19:12:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be, skipping ID generation
2026-03-27 19:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with scrape type 1
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be sending to next pipeline
2026-03-27 19:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be, identifier: FK48987
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_6ddb811f4fff440e7398a84fb58b1c14.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_6ddb811f4fff440e7398a84fb58b1c14.jpg not downloaded yet
2026-03-27 19:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP69601/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with identifier: FK48987
2026-03-27 19:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with identifier: FK48987
2026-03-27 19:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with identifier: FK48987 to the API
2026-03-27 19:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_73d1cc00afd655c4dca886c716e5f619.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:44:52Z',
 'fuel_type': 'petrol',
 'id': '14c57f01-983c-512a-b7b3-5cd8f8a8a0be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '29XRR8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK48987',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 232858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_73d1cc00afd655c4dca886c716e5f619.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_c3d3315eb8baeb5138dc772afa46aa19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_a0ff53c57aa33caf31cb64985ceffed9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_ed7a22e6dc1fb0a4dec63bf8b9e37c72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14c57f01-983c-512a-b7b3-5cd8f8a8a0be/14c57f01-983c-512a-b7b3-5cd8f8a8a0be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/49/59493bf9afa21e11fba7104c63f53cf4/pa/FK48987_c8973cf57a7f742247e0a88bd8986754.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-27 19:12:31 [auto1.nl] INFO: Saving data for FK48987: {'created_time': 1774638751.23639, 'last_price_update_time': 1774638751.236402, 'auction_closing_time': 1774716292.0}
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK48987') HTTP/1.1" 204 0
2026-03-27 19:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_e01279b0e1930a758e66c5734898409e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_e01279b0e1930a758e66c5734898409e.jpg not downloaded yet
2026-03-27 19:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY58487/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:31 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 916 | hits on page: 40
2026-03-27 19:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_9961f136df0647fa78735c58a5d1dfba.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_57c2978ba5af8dbd850c5b420bda1c79.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_57c2978ba5af8dbd850c5b420bda1c79.jpg not downloaded yet
2026-03-27 19:12:31 [auto1.nl] INFO: Found listing with ID: JK11532
2026-03-27 19:12:31 [auto1.nl] INFO: Found listing with ID: HK93829
2026-03-27 19:12:31 [auto1.nl] INFO: Found listing with ID: RF47261
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF47261%27 HTTP/1.1" 200 None
2026-03-27 19:12:31 [auto1.nl] INFO: Scrape type for RF47261: 2
2026-03-27 19:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd28970-e5a6-5e3e-a1fe-260b44341c8d with identifier: RF47261
2026-03-27 19:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd28970-e5a6-5e3e-a1fe-260b44341c8d with scrape type 2
2026-03-27 19:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfd28970-e5a6-5e3e-a1fe-260b44341c8d with scrape type 2
2026-03-27 19:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bfd28970-e5a6-5e3e-a1fe-260b44341c8d, identifier: RF47261
2026-03-27 19:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ50492/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bfd28970-e5a6-5e3e-a1fe-260b44341c8d with identifier: RF47261
2026-03-27 19:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bfd28970-e5a6-5e3e-a1fe-260b44341c8d with identifier: RF47261
2026-03-27 19:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bfd28970-e5a6-5e3e-a1fe-260b44341c8d with identifier: RF47261 to the API
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:13:41Z',
 'fuel_type': 'petrol',
 'id': 'bfd28970-e5a6-5e3e-a1fe-260b44341c8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF47261',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka+',
 'odometer': 72604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-08',
 'seller_name': None,
 'title': 'Ford Ka+ 1.2 Ti-VCT Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF47261%27 HTTP/1.1" 200 None
2026-03-27 19:12:31 [auto1.nl] INFO: Saving data for RF47261: {'auction_closing_time': 1774714421.0, 'created_time': 1773342941.454597, 'last_price_update_time': 1774638751.73574}
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF47261') HTTP/1.1" 204 0
2026-03-27 19:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_f31b46ee4500a25800612b6f19d2c9b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_f31b46ee4500a25800612b6f19d2c9b4.jpg not downloaded yet
2026-03-27 19:12:31 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-27 19:12:31 [auto1.nl] INFO: Scrape type for BY07410: 2
2026-03-27 19:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410
2026-03-27 19:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224f6637-7c71-548e-8dbe-10d58d9ac847 with scrape type 2
2026-03-27 19:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224f6637-7c71-548e-8dbe-10d58d9ac847 with scrape type 2
2026-03-27 19:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 224f6637-7c71-548e-8dbe-10d58d9ac847, identifier: BY07410
2026-03-27 19:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410
2026-03-27 19:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410
2026-03-27 19:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410 to the API
2026-03-27 19:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:40:40Z',
 'fuel_type': 'petrol',
 'id': '224f6637-7c71-548e-8dbe-10d58d9ac847',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY07410',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3 Cabrio',
 'odometer': 132796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Citroen DS3 Cabrio 1.6 VTi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2013}
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-27 19:12:32 [auto1.nl] INFO: Saving data for BY07410: {'auction_closing_time': 1774716040.0, 'created_time': 1773927659.32465, 'last_price_update_time': 1774638752.144912}
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY07410') HTTP/1.1" 204 0
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_2e1d57f6132de2a533fd0956733b1873.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_2e1d57f6132de2a533fd0956733b1873.jpg not downloaded yet
2026-03-27 19:12:32 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-27 19:12:32 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-27 19:12:32 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-27 19:12:32 [auto1.nl] INFO: Scrape type for KZ40216: 2
2026-03-27 19:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216
2026-03-27 19:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with scrape type 2
2026-03-27 19:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with scrape type 2
2026-03-27 19:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f, identifier: KZ40216
2026-03-27 19:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216
2026-03-27 19:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216
2026-03-27 19:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216 to the API
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:02:08Z',
 'fuel_type': 'petrol',
 'id': '03e329dd-f4f2-54a2-af8a-dd2eded85e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ40216',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 195392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-22',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2013}
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-27 19:12:32 [auto1.nl] INFO: Saving data for KZ40216: {'auction_closing_time': 1774713728.0, 'created_time': 1773861356.385734, 'last_price_update_time': 1774638752.525244}
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KZ40216') HTTP/1.1" 204 0
2026-03-27 19:12:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29808d0>
2026-03-27 19:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_9961f136df0647fa78735c58a5d1dfba.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_9961f136df0647fa78735c58a5d1dfba.jpg saved to cache
2026-03-27 19:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_b2fb53f940215af4e2e9457921467a2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_b2fb53f940215af4e2e9457921467a2c.jpg not downloaded yet
2026-03-27 19:12:32 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-27 19:12:32 [auto1.nl] INFO: Scrape type for VD19679: 2
2026-03-27 19:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679
2026-03-27 19:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f8d6cd-6bff-55b1-83b0-736023b02205 with scrape type 2
2026-03-27 19:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f8d6cd-6bff-55b1-83b0-736023b02205 with scrape type 2
2026-03-27 19:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 97f8d6cd-6bff-55b1-83b0-736023b02205, identifier: VD19679
2026-03-27 19:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD17412> (referer: https://www.auto1.com/v1/car-details-view/HD17412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP95967> (referer: https://www.auto1.com/v1/car-details-view/WP95967/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679
2026-03-27 19:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679
2026-03-27 19:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679 to the API
2026-03-27 19:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:12Z',
 'fuel_type': 'diesel',
 'id': '97f8d6cd-6bff-55b1-83b0-736023b02205',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD19679',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 233118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Saving data for VD19679: {'auction_closing_time': 1774715172.0, 'created_time': 1774268182.880489, 'last_price_update_time': 1774638753.164636}
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD19679') HTTP/1.1" 204 0
2026-03-27 19:12:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_02c88f719e06d450c7316f86cdc540d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_02c88f719e06d450c7316f86cdc540d5.jpg not downloaded yet
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for FZ85660: 2
2026-03-27 19:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d1904a1-bf39-55bf-be04-9799c574d331 with identifier: FZ85660
2026-03-27 19:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d1904a1-bf39-55bf-be04-9799c574d331 with scrape type 2
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d1904a1-bf39-55bf-be04-9799c574d331 with scrape type 2
2026-03-27 19:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0d1904a1-bf39-55bf-be04-9799c574d331, identifier: FZ85660
2026-03-27 19:12:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0d1904a1-bf39-55bf-be04-9799c574d331 with identifier: FZ85660
2026-03-27 19:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0d1904a1-bf39-55bf-be04-9799c574d331 with identifier: FZ85660
2026-03-27 19:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0d1904a1-bf39-55bf-be04-9799c574d331 with identifier: FZ85660 to the API
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:58:12Z',
 'fuel_type': 'diesel',
 'id': '0d1904a1-bf39-55bf-be04-9799c574d331',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ85660',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 211066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-13',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D4 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2014}
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Saving data for FZ85660: {'auction_closing_time': 1774717092.0, 'created_time': 1774354375.849345, 'last_price_update_time': 1774638753.580186}
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FZ85660') HTTP/1.1" 204 0
2026-03-27 19:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ05110> (referer: https://www.auto1.com/v1/car-details-view/UJ05110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN82428> (referer: https://www.auto1.com/v1/car-details-view/PN82428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_f63a52d734bbe7863ed7ddcb92ab994a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_f63a52d734bbe7863ed7ddcb92ab994a.jpg not downloaded yet
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for VM41876: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for CP77095: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for YZ85937: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for AB34968: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP44065%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for HP44065: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for VB96147: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for WW80908: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA14742%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for HA14742: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD39017%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for JD39017: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for TH29476: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for GG02103: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for PY55457: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB17984%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for GB17984: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH77043%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [auto1.nl] INFO: Scrape type for LH77043: 0
2026-03-27 19:12:33 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-27 19:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR49127> (referer: https://www.auto1.com/v1/car-details-view/YR49127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with identifier: HD17412
2026-03-27 19:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with scrape type 1
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_d78466972adf004f558d272270febc0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_d78466972adf004f558d272270febc0e.jpg not downloaded yet
2026-03-27 19:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc898ff4-2139-54fa-9dd0-de35a68bd729 with identifier: WP95967
2026-03-27 19:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc898ff4-2139-54fa-9dd0-de35a68bd729 with scrape type 1
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_0bb83de341491dd510779da9e4c6f2ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_0bb83de341491dd510779da9e4c6f2ac.jpg not downloaded yet
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_d0f29e41b223926183744cb667a8baa6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_d0f29e41b223926183744cb667a8baa6.jpg not downloaded yet
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_8babb4c163a9d3735e78cd6cca5a8a95.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_8babb4c163a9d3735e78cd6cca5a8a95.jpg not downloaded yet
2026-03-27 19:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR15886> (referer: https://www.auto1.com/v1/car-details-view/NR15886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_9ac690eaa64b1f9a6105037d9c9f188f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_9ac690eaa64b1f9a6105037d9c9f188f.jpg not downloaded yet
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_3990fa13ac33163a732dbc009c6af076.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3990fa13ac33163a732dbc009c6af076.jpg not downloaded yet
2026-03-27 19:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with identifier: UJ05110
2026-03-27 19:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with scrape type 1
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_0330c8eb91518882ef09fa1f7916a446.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_0330c8eb91518882ef09fa1f7916a446.jpg not downloaded yet
2026-03-27 19:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14cf79ee-0f10-554b-95d2-43660ad6962e with identifier: PN82428
2026-03-27 19:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14cf79ee-0f10-554b-95d2-43660ad6962e with scrape type 1
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 14cf79ee-0f10-554b-95d2-43660ad6962e
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_17acacc29d9fb24e62d82db019505356.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_17acacc29d9fb24e62d82db019505356.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_1cb31d262db6c16ed52dde393cc02960.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_1cb31d262db6c16ed52dde393cc02960.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_3048710f9b3fd66fdef4d75e12403832.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3048710f9b3fd66fdef4d75e12403832.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_4ce4f7dfbce9a14c0ac5010803e3a3ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_4ce4f7dfbce9a14c0ac5010803e3a3ac.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_4b094b464bdab9ecd53555fea0413ef1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_4b094b464bdab9ecd53555fea0413ef1.jpg not downloaded yet
2026-03-27 19:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c27b70ed-0a59-5f7b-bc13-c42d28190b64 with identifier: YR49127
2026-03-27 19:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c27b70ed-0a59-5f7b-bc13-c42d28190b64 with scrape type 1
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_6f2b47a76136367945a6a257bda1b988.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_6f2b47a76136367945a6a257bda1b988.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_abe59fd3488691a91b689caa68be713c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_abe59fd3488691a91b689caa68be713c.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_2cb22eb60d2cfdd235801b2f661f536e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_2cb22eb60d2cfdd235801b2f661f536e.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_77ca95e61d5039db8bcc5dce50e02c7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_77ca95e61d5039db8bcc5dce50e02c7a.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_ed1738336a71ed6277580f08e760eb11.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_ed1738336a71ed6277580f08e760eb11.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_262a8a47687710c791920b12f2c06ab4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_262a8a47687710c791920b12f2c06ab4.jpg not downloaded yet
2026-03-27 19:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU12203> (referer: https://www.auto1.com/v1/car-details-view/VU12203/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dad77f45-1ffc-5939-8aaf-1a5047447fff with identifier: NR15886
2026-03-27 19:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dad77f45-1ffc-5939-8aaf-1a5047447fff with scrape type 1
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item dad77f45-1ffc-5939-8aaf-1a5047447fff
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_3dcf01e113bcac5d072fae27b33f6d35.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_3dcf01e113bcac5d072fae27b33f6d35.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_b84fd6eebc488d29fb8ef0dd688956ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_b84fd6eebc488d29fb8ef0dd688956ef.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_888b09ab7e97b9fa53fd03c04ee43338.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_888b09ab7e97b9fa53fd03c04ee43338.jpg not downloaded yet
2026-03-27 19:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_57b15f3e2081d4c794e04b835c6cf2da.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_6db5a193f36217ec89b11a29425631d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_6db5a193f36217ec89b11a29425631d1.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_6ecccfe0ceaf60645fa7568b558af9e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_6ecccfe0ceaf60645fa7568b558af9e8.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_a9b2dd7fa0c359feab1bac917c331bdb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_a9b2dd7fa0c359feab1bac917c331bdb.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_083d21de98b6d612fb663b4a74d51bbf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_083d21de98b6d612fb663b4a74d51bbf.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_87ac85aae74b7a0d9cd7afc85bad1742.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_87ac85aae74b7a0d9cd7afc85bad1742.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_3428e2f22dd6bffcd9642c35e3870a95.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3428e2f22dd6bffcd9642c35e3870a95.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_3da98561fe0641f8837869c29cb8943b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_3da98561fe0641f8837869c29cb8943b.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_32049e0d46b6f1948049145d70404ecc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_32049e0d46b6f1948049145d70404ecc.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_1ea7447e40553a86079e79f75ed95f2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_1ea7447e40553a86079e79f75ed95f2f.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_27426704cfdc13230fb8359fe1ade8f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_27426704cfdc13230fb8359fe1ade8f6.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_5083b2cac89cab90193e4ddb3addbc12.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_5083b2cac89cab90193e4ddb3addbc12.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_b19155f2b9a4100e8e26a40222a5c1ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_b19155f2b9a4100e8e26a40222a5c1ed.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_0cf2d409c0dabcfa40b8f29be5889bc7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_0cf2d409c0dabcfa40b8f29be5889bc7.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_250d42ea7e8b7a16fe943f4095028df0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_250d42ea7e8b7a16fe943f4095028df0.jpg not downloaded yet
2026-03-27 19:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with identifier: VU12203
2026-03-27 19:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with scrape type 1
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 679d5a25-7a1c-53a0-a08d-a57284e6b6ef
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_c381b3b7186bd9a942d5c5333aa83179.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_c381b3b7186bd9a942d5c5333aa83179.jpg already downloaded
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_934adf852745bfbc980527d25ee0ee94.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_934adf852745bfbc980527d25ee0ee94.jpg already downloaded
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_4b9ed5e19aff1af36261adf1d371ccd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_4b9ed5e19aff1af36261adf1d371ccd5.jpg already downloaded
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_5890954b607e96fc0c96dc6208b87760.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_5890954b607e96fc0c96dc6208b87760.jpg already downloaded
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_f4b50d601b93327b05decfda2d898d9f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_f4b50d601b93327b05decfda2d898d9f.jpg already downloaded
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_f7fe89823f3a4959262b4592e792706e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_f7fe89823f3a4959262b4592e792706e.jpg already downloaded
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_c2941960dcd72fa8ccd3863e029913ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_c2941960dcd72fa8ccd3863e029913ed.jpg already downloaded
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_913c4452a5d81acbf33799571024987c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_913c4452a5d81acbf33799571024987c.jpg already downloaded
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_71506a49ba0d7216618701bfa246bf98.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_71506a49ba0d7216618701bfa246bf98.jpg already downloaded
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F03%252Ffc03752aebb888b5181101665f82e5ca%252Fpa%252FVU12203_0b103d333a5f34febc3146402bb09a1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_0b103d333a5f34febc3146402bb09a1d.jpg already downloaded
2026-03-27 19:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef, identifier: VU12203
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_63c91ba8017e9fb50545dfd3546618d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_63c91ba8017e9fb50545dfd3546618d6.jpg not downloaded yet
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_e22bf3ea6d124608be244b63d54aab28.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_e22bf3ea6d124608be244b63d54aab28.jpg not downloaded yet
2026-03-27 19:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with identifier: VU12203
2026-03-27 19:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with identifier: VU12203
2026-03-27 19:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with identifier: VU12203 to the API
2026-03-27 19:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VU12203>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:55:53Z',
 'fuel_type': 'petrol',
 'id': '679d5a25-7a1c-53a0-a08d-a57284e6b6ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'Z-714-BJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU12203',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 115659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_c381b3b7186bd9a942d5c5333aa83179.jpg',
                'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_934adf852745bfbc980527d25ee0ee94.jpg',
                'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_4b9ed5e19aff1af36261adf1d371ccd5.jpg',
                'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_5890954b607e96fc0c96dc6208b87760.jpg',
                'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_f4b50d601b93327b05decfda2d898d9f.jpg',
                'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_f7fe89823f3a4959262b4592e792706e.jpg',
                'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_c2941960dcd72fa8ccd3863e029913ed.jpg',
                'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_913c4452a5d81acbf33799571024987c.jpg',
                'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_71506a49ba0d7216618701bfa246bf98.jpg',
                'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_0b103d333a5f34febc3146402bb09a1d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2785828,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_c381b3b7186bd9a942d5c5333aa83179.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2742934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_934adf852745bfbc980527d25ee0ee94.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_4b9ed5e19aff1af36261adf1d371ccd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2668844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_5890954b607e96fc0c96dc6208b87760.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414118,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_f4b50d601b93327b05decfda2d898d9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2767960,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_f7fe89823f3a4959262b4592e792706e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_c2941960dcd72fa8ccd3863e029913ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2776959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_913c4452a5d81acbf33799571024987c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2646515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_71506a49ba0d7216618701bfa246bf98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679d5a25-7a1c-53a0-a08d-a57284e6b6ef/679d5a25-7a1c-53a0-a08d-a57284e6b6ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2952316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/03/fc03752aebb888b5181101665f82e5ca/pa/VU12203_0b103d333a5f34febc3146402bb09a1d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [auto1.nl] INFO: Saving data for VU12203: {'created_time': 1774638755.149599, 'last_price_update_time': 1774638755.149609, 'auction_closing_time': 1774716953.0}
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VU12203') HTTP/1.1" 204 0
2026-03-27 19:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_38dd763c9bce8924c7cb2e01d7eef574.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_c7bb4f1e6915f295b5b60ebf3eaf3d50.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_c7bb4f1e6915f295b5b60ebf3eaf3d50.jpg not downloaded yet
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_1363a469b5a3523990ad92e1d9ae7ffe.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_1363a469b5a3523990ad92e1d9ae7ffe.jpg not downloaded yet
2026-03-27 19:12:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29467d0>
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_57b15f3e2081d4c794e04b835c6cf2da.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_57b15f3e2081d4c794e04b835c6cf2da.jpg saved to cache
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_bd406371845a43655459d6426932cd70.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_6cad3e834a10232469bd8fa5ed58f8df.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_6cad3e834a10232469bd8fa5ed58f8df.jpg not downloaded yet
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_d34520755368d5edaa923faf2d752671.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_d34520755368d5edaa923faf2d752671.jpg not downloaded yet
2026-03-27 19:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY58487> (referer: https://www.auto1.com/v1/car-details-view/JY58487/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_8f38a83c413d51467ce7a64f2f6b5eb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_ff47beaa57a01392f1e2d1210584d93c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_ff47beaa57a01392f1e2d1210584d93c.jpg not downloaded yet
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_e87300b80fa71b1e45f3d438d34bf4a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_e87300b80fa71b1e45f3d438d34bf4a1.jpg not downloaded yet
2026-03-27 19:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP69601> (referer: https://www.auto1.com/v1/car-details-view/NP69601/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ50492> (referer: https://www.auto1.com/v1/car-details-view/MZ50492/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3294050>
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_38dd763c9bce8924c7cb2e01d7eef574.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_38dd763c9bce8924c7cb2e01d7eef574.jpg saved to cache
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_765c8abca54bb20cdc2d88c72267cd6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_765c8abca54bb20cdc2d88c72267cd6b.jpg not downloaded yet
2026-03-27 19:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_6ddb811f4fff440e7398a84fb58b1c14.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_a718dc83836f6b4bc549deb8de891f61.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_a718dc83836f6b4bc549deb8de891f61.jpg not downloaded yet
2026-03-27 19:12:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae333d610>
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_bd406371845a43655459d6426932cd70.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_bd406371845a43655459d6426932cd70.jpg saved to cache
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8 with identifier: JY58487
2026-03-27 19:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8 with scrape type 1
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_973e992d73ebcec733ef20d7f3006330.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_973e992d73ebcec733ef20d7f3006330.jpg not downloaded yet
2026-03-27 19:12:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae283dc10>
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_8f38a83c413d51467ce7a64f2f6b5eb4.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_8f38a83c413d51467ce7a64f2f6b5eb4.jpg saved to cache
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with identifier: NP69601
2026-03-27 19:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with scrape type 1
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_63baa400673315216a16127fe340098b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_63baa400673315216a16127fe340098b.jpg not downloaded yet
2026-03-27 19:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b4421b8-dfae-511a-a22e-7e9f721f738c with identifier: MZ50492
2026-03-27 19:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b4421b8-dfae-511a-a22e-7e9f721f738c with scrape type 1
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 8b4421b8-dfae-511a-a22e-7e9f721f738c
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9b%252F3b9bfa5f4d06f8e63b3be4d538c34a90%252Fpa%252FMZ50492_69e48e61abd1097d4ddaab20f7d61b3d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_69e48e61abd1097d4ddaab20f7d61b3d.jpg already downloaded
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9b%252F3b9bfa5f4d06f8e63b3be4d538c34a90%252Fpa%252FMZ50492_584eea33c6e642aead804d1c410a571b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_584eea33c6e642aead804d1c410a571b.jpg already downloaded
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9b%252F3b9bfa5f4d06f8e63b3be4d538c34a90%252Fpa%252FMZ50492_d3bfffdcb72c054d73cb98e62078e80e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_d3bfffdcb72c054d73cb98e62078e80e.jpg already downloaded
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9b%252F3b9bfa5f4d06f8e63b3be4d538c34a90%252Fpa%252FMZ50492_b5ccdc971634c8ca0f4fc9e6e3716f25.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_b5ccdc971634c8ca0f4fc9e6e3716f25.jpg already downloaded
2026-03-27 19:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b4421b8-dfae-511a-a22e-7e9f721f738c, identifier: MZ50492
2026-03-27 19:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b4421b8-dfae-511a-a22e-7e9f721f738c with identifier: MZ50492
2026-03-27 19:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b4421b8-dfae-511a-a22e-7e9f721f738c with identifier: MZ50492
2026-03-27 19:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b4421b8-dfae-511a-a22e-7e9f721f738c with identifier: MZ50492 to the API
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MZ50492>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:34:11Z',
 'fuel_type': 'diesel',
 'id': '8b4421b8-dfae-511a-a22e-7e9f721f738c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '4TKT44',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ50492',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 198186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photo_urls': ['https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_69e48e61abd1097d4ddaab20f7d61b3d.jpg',
                'https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_584eea33c6e642aead804d1c410a571b.jpg',
                'https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_d3bfffdcb72c054d73cb98e62078e80e.jpg',
                'https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_b5ccdc971634c8ca0f4fc9e6e3716f25.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4421b8-dfae-511a-a22e-7e9f721f738c/8b4421b8-dfae-511a-a22e-7e9f721f738c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_69e48e61abd1097d4ddaab20f7d61b3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4421b8-dfae-511a-a22e-7e9f721f738c/8b4421b8-dfae-511a-a22e-7e9f721f738c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_584eea33c6e642aead804d1c410a571b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4421b8-dfae-511a-a22e-7e9f721f738c/8b4421b8-dfae-511a-a22e-7e9f721f738c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_d3bfffdcb72c054d73cb98e62078e80e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b4421b8-dfae-511a-a22e-7e9f721f738c/8b4421b8-dfae-511a-a22e-7e9f721f738c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9b/3b9bfa5f4d06f8e63b3be4d538c34a90/pa/MZ50492_b5ccdc971634c8ca0f4fc9e6e3716f25.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi DPF Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [auto1.nl] INFO: Saving data for MZ50492: {'created_time': 1774638756.271681, 'last_price_update_time': 1774638756.271691, 'auction_closing_time': 1774715651.0}
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ50492') HTTP/1.1" 204 0
2026-03-27 19:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_a4862cbbfae85bb00b8068321147ea67.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_335d0e5c448d8ef4a55fab2b710b659f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_335d0e5c448d8ef4a55fab2b710b659f.jpg not downloaded yet
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_7f02b377e9072793a8717b4570175240.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_7f02b377e9072793a8717b4570175240.jpg not downloaded yet
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_ff3c85c32cba147606eb153dc891a409.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_ff3c85c32cba147606eb153dc891a409.jpg not downloaded yet
2026-03-27 19:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_3dcf01e113bcac5d072fae27b33f6d35.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL63517> (referer: https://www.auto1.com/v1/car-details-view/FL63517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32a8190>
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_6ddb811f4fff440e7398a84fb58b1c14.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_6ddb811f4fff440e7398a84fb58b1c14.jpg saved to cache
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_4dad9c0d565499c9615c969a495b5906.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_4dad9c0d565499c9615c969a495b5906.jpg not downloaded yet
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_74fe94ebe43a37bd0aea4f0671242c6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_74fe94ebe43a37bd0aea4f0671242c6a.jpg not downloaded yet
2026-03-27 19:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_a64149530d66da1c3b706015c96156f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_8079b9d37a2d674319385587316aab94.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_8079b9d37a2d674319385587316aab94.jpg not downloaded yet
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_cbb1f134193e0f01b77ad5c49b6621aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_cbb1f134193e0f01b77ad5c49b6621aa.jpg not downloaded yet
2026-03-27 19:12:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2812fd0>
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_a4862cbbfae85bb00b8068321147ea67.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_a4862cbbfae85bb00b8068321147ea67.jpg saved to cache
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9673010>
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_3dcf01e113bcac5d072fae27b33f6d35.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_3dcf01e113bcac5d072fae27b33f6d35.jpg saved to cache
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dad77f45-1ffc-5939-8aaf-1a5047447fff
2026-03-27 19:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06cde6ab-138c-552f-99a1-d0985008df27 with identifier: FL63517
2026-03-27 19:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06cde6ab-138c-552f-99a1-d0985008df27 with scrape type 1
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 06cde6ab-138c-552f-99a1-d0985008df27
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_9ade4cd4885a88c9d2af19317b66f8dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_9ade4cd4885a88c9d2af19317b66f8dc.jpg not downloaded yet
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_57b156868c29236df0e814958082abb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_57b156868c29236df0e814958082abb1.jpg not downloaded yet
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_b76a72da8c1fad9df4781548fe6f38be.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_b76a72da8c1fad9df4781548fe6f38be.jpg not downloaded yet
2026-03-27 19:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_335d0e5c448d8ef4a55fab2b710b659f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_7f02b377e9072793a8717b4570175240.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_7732fdf492890a232bbf90ebb4c213a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_7732fdf492890a232bbf90ebb4c213a0.jpg not downloaded yet
2026-03-27 19:12:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33e1690>
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_a64149530d66da1c3b706015c96156f5.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_a64149530d66da1c3b706015c96156f5.jpg saved to cache
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_0ff0de63858c6d02ea33706da06d89a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_0ff0de63858c6d02ea33706da06d89a3.jpg not downloaded yet
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_304142e9b24d28dc334cc28962ff58c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_304142e9b24d28dc334cc28962ff58c1.jpg not downloaded yet
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_834302b2b4606e4ff14ce000e79f2d37.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_834302b2b4606e4ff14ce000e79f2d37.jpg not downloaded yet
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae346ced0>
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_335d0e5c448d8ef4a55fab2b710b659f.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_335d0e5c448d8ef4a55fab2b710b659f.jpg saved to cache
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32b32d0>
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_7f02b377e9072793a8717b4570175240.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_7f02b377e9072793a8717b4570175240.jpg saved to cache
2026-03-27 19:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8
2026-03-27 19:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_b2fb53f940215af4e2e9457921467a2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_67fafb7c1f86def9032a5b1a4e2a78e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_67fafb7c1f86def9032a5b1a4e2a78e1.jpg not downloaded yet
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_179765d4b4c258ae8d22dd52e4f874f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_179765d4b4c258ae8d22dd52e4f874f9.jpg not downloaded yet
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_973e992d73ebcec733ef20d7f3006330.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_465a207a90770f274cd58a2ca186720d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_465a207a90770f274cd58a2ca186720d.jpg not downloaded yet
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_752d9943f82c8d97937d09c1eb630ad4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_752d9943f82c8d97937d09c1eb630ad4.jpg not downloaded yet
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_f42fb5f88008928f23d010eee26949d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_f42fb5f88008928f23d010eee26949d7.jpg not downloaded yet
2026-03-27 19:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2832790>
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_b2fb53f940215af4e2e9457921467a2c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_b2fb53f940215af4e2e9457921467a2c.jpg saved to cache
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_02c88f719e06d450c7316f86cdc540d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae28316d0>
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_973e992d73ebcec733ef20d7f3006330.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_973e992d73ebcec733ef20d7f3006330.jpg saved to cache
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_0bb83de341491dd510779da9e4c6f2ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_8babb4c163a9d3735e78cd6cca5a8a95.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_262a8a47687710c791920b12f2c06ab4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_ff3c85c32cba147606eb153dc891a409.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_765c8abca54bb20cdc2d88c72267cd6b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29d8410>
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_02c88f719e06d450c7316f86cdc540d5.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_02c88f719e06d450c7316f86cdc540d5.jpg saved to cache
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_63baa400673315216a16127fe340098b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_e87300b80fa71b1e45f3d438d34bf4a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_9ade4cd4885a88c9d2af19317b66f8dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3444850>
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_0bb83de341491dd510779da9e4c6f2ac.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_0bb83de341491dd510779da9e4c6f2ac.jpg saved to cache
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae333b550>
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_8babb4c163a9d3735e78cd6cca5a8a95.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_8babb4c163a9d3735e78cd6cca5a8a95.jpg saved to cache
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae358c790>
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_262a8a47687710c791920b12f2c06ab4.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_262a8a47687710c791920b12f2c06ab4.jpg saved to cache
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3308290>
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_ff3c85c32cba147606eb153dc891a409.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_ff3c85c32cba147606eb153dc891a409.jpg saved to cache
2026-03-27 19:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae297eb90>
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_765c8abca54bb20cdc2d88c72267cd6b.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_765c8abca54bb20cdc2d88c72267cd6b.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_304142e9b24d28dc334cc28962ff58c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_67fafb7c1f86def9032a5b1a4e2a78e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29e5810>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_63baa400673315216a16127fe340098b.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_63baa400673315216a16127fe340098b.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae335b0d0>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_e87300b80fa71b1e45f3d438d34bf4a1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_e87300b80fa71b1e45f3d438d34bf4a1.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dad77f45-1ffc-5939-8aaf-1a5047447fff
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2914fd0>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_9ade4cd4885a88c9d2af19317b66f8dc.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_9ade4cd4885a88c9d2af19317b66f8dc.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06cde6ab-138c-552f-99a1-d0985008df27
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3295dd0>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_304142e9b24d28dc334cc28962ff58c1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_304142e9b24d28dc334cc28962ff58c1.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06cde6ab-138c-552f-99a1-d0985008df27
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae331e810>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_67fafb7c1f86def9032a5b1a4e2a78e1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_67fafb7c1f86def9032a5b1a4e2a78e1.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06cde6ab-138c-552f-99a1-d0985008df27
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_a718dc83836f6b4bc549deb8de891f61.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_465a207a90770f274cd58a2ca186720d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_d34520755368d5edaa923faf2d752671.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_cbb1f134193e0f01b77ad5c49b6621aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_74fe94ebe43a37bd0aea4f0671242c6a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_ff47beaa57a01392f1e2d1210584d93c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_7732fdf492890a232bbf90ebb4c213a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_57b156868c29236df0e814958082abb1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae826e110>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_a718dc83836f6b4bc549deb8de891f61.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_a718dc83836f6b4bc549deb8de891f61.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae328f5d0>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_465a207a90770f274cd58a2ca186720d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_465a207a90770f274cd58a2ca186720d.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06cde6ab-138c-552f-99a1-d0985008df27
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_4dad9c0d565499c9615c969a495b5906.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_8079b9d37a2d674319385587316aab94.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae331fb90>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_d34520755368d5edaa923faf2d752671.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_d34520755368d5edaa923faf2d752671.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29e3150>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_cbb1f134193e0f01b77ad5c49b6621aa.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_cbb1f134193e0f01b77ad5c49b6621aa.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae966ac90>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_74fe94ebe43a37bd0aea4f0671242c6a.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_74fe94ebe43a37bd0aea4f0671242c6a.jpg saved to cache
2026-03-27 19:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae347af90>
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_ff47beaa57a01392f1e2d1210584d93c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_ff47beaa57a01392f1e2d1210584d93c.jpg saved to cache
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae291f910>
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ffc%252F69fc5d1137bae8ce19570bb8bfc74757%252Fpa%252FFL63517_7732fdf492890a232bbf90ebb4c213a0.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_7732fdf492890a232bbf90ebb4c213a0.jpg saved to cache
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06cde6ab-138c-552f-99a1-d0985008df27
2026-03-27 19:12:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06cde6ab-138c-552f-99a1-d0985008df27, skipping ID generation
2026-03-27 19:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06cde6ab-138c-552f-99a1-d0985008df27 with scrape type 1
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06cde6ab-138c-552f-99a1-d0985008df27 sending to next pipeline
2026-03-27 19:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 06cde6ab-138c-552f-99a1-d0985008df27, identifier: FL63517
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae331cbd0>
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_57b156868c29236df0e814958082abb1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_57b156868c29236df0e814958082abb1.jpg saved to cache
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8
2026-03-27 19:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 06cde6ab-138c-552f-99a1-d0985008df27 with identifier: FL63517
2026-03-27 19:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 06cde6ab-138c-552f-99a1-d0985008df27 with identifier: FL63517
2026-03-27 19:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 06cde6ab-138c-552f-99a1-d0985008df27 with identifier: FL63517 to the API
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_7732fdf492890a232bbf90ebb4c213a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:43:44Z',
 'fuel_type': 'petrol',
 'id': '06cde6ab-138c-552f-99a1-d0985008df27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '03GHG2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL63517',
 'listing': 'auction',
 'location': 'NL, Goes',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 226687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_9ade4cd4885a88c9d2af19317b66f8dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_7732fdf492890a232bbf90ebb4c213a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_304142e9b24d28dc334cc28962ff58c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_67fafb7c1f86def9032a5b1a4e2a78e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06cde6ab-138c-552f-99a1-d0985008df27/06cde6ab-138c-552f-99a1-d0985008df27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/fc/69fc5d1137bae8ce19570bb8bfc74757/pa/FL63517_465a207a90770f274cd58a2ca186720d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 X-Line',
 'transmission': 'manual',
 'trim': 'X-Line',
 'year': 2008}
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-27 19:12:39 [auto1.nl] INFO: Saving data for FL63517: {'created_time': 1774638759.655289, 'last_price_update_time': 1774638759.655299, 'auction_closing_time': 1774716224.0}
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FL63517') HTTP/1.1" 204 0
2026-03-27 19:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_1363a469b5a3523990ad92e1d9ae7ffe.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2919b90>
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_4dad9c0d565499c9615c969a495b5906.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_4dad9c0d565499c9615c969a495b5906.jpg saved to cache
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33615d0>
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0f%252Fb00f524b533bc4501e2a1ac3301eb206%252Fpa%252FJY58487_8079b9d37a2d674319385587316aab94.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_8079b9d37a2d674319385587316aab94.jpg saved to cache
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8
2026-03-27 19:12:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8, skipping ID generation
2026-03-27 19:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8 with scrape type 1
2026-03-27 19:12:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8 sending to next pipeline
2026-03-27 19:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8, identifier: JY58487
2026-03-27 19:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_752d9943f82c8d97937d09c1eb630ad4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8 with identifier: JY58487
2026-03-27 19:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8 with identifier: JY58487
2026-03-27 19:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ca45ec0-c49e-5aa8-bfc1-7908baea82d8 with identifier: JY58487 to the API
2026-03-27 19:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_8079b9d37a2d674319385587316aab94.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:13:13Z',
 'fuel_type': 'petrol',
 'id': '4ca45ec0-c49e-5aa8-bfc1-7908baea82d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '1KRK20',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY58487',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 61590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_973e992d73ebcec733ef20d7f3006330.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_7f02b377e9072793a8717b4570175240.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_4dad9c0d565499c9615c969a495b5906.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_8079b9d37a2d674319385587316aab94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca45ec0-c49e-5aa8-bfc1-7908baea82d8/4ca45ec0-c49e-5aa8-bfc1-7908baea82d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0f/b00f524b533bc4501e2a1ac3301eb206/pa/JY58487_57b156868c29236df0e814958082abb1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY58487%27 HTTP/1.1" 200 None
2026-03-27 19:12:40 [auto1.nl] INFO: Saving data for JY58487: {'created_time': 1774638760.196812, 'last_price_update_time': 1774638760.196822, 'auction_closing_time': 1774714393.0}
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JY58487') HTTP/1.1" 204 0
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29d35d0>
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_1363a469b5a3523990ad92e1d9ae7ffe.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_1363a469b5a3523990ad92e1d9ae7ffe.jpg saved to cache
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dad77f45-1ffc-5939-8aaf-1a5047447fff
2026-03-27 19:12:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2919b90>
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_752d9943f82c8d97937d09c1eb630ad4.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_752d9943f82c8d97937d09c1eb630ad4.jpg saved to cache
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_f42fb5f88008928f23d010eee26949d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_834302b2b4606e4ff14ce000e79f2d37.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_0ff0de63858c6d02ea33706da06d89a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_179765d4b4c258ae8d22dd52e4f874f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_b76a72da8c1fad9df4781548fe6f38be.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_6cad3e834a10232469bd8fa5ed58f8df.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_c7bb4f1e6915f295b5b60ebf3eaf3d50.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32c2310>
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_f42fb5f88008928f23d010eee26949d7.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_f42fb5f88008928f23d010eee26949d7.jpg saved to cache
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_27426704cfdc13230fb8359fe1ade8f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_250d42ea7e8b7a16fe943f4095028df0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae357e310>
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_834302b2b4606e4ff14ce000e79f2d37.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_834302b2b4606e4ff14ce000e79f2d37.jpg saved to cache
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae357dd90>
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_0ff0de63858c6d02ea33706da06d89a3.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_0ff0de63858c6d02ea33706da06d89a3.jpg saved to cache
2026-03-27 19:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32b08d0>
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_179765d4b4c258ae8d22dd52e4f874f9.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_179765d4b4c258ae8d22dd52e4f874f9.jpg saved to cache
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33e2ad0>
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F68%252F9168d0983d2c2ad32d78d087eea40882%252Fpa%252FNP69601_b76a72da8c1fad9df4781548fe6f38be.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_b76a72da8c1fad9df4781548fe6f38be.jpg saved to cache
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5
2026-03-27 19:12:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5, skipping ID generation
2026-03-27 19:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with scrape type 1
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 sending to next pipeline
2026-03-27 19:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5, identifier: NP69601
2026-03-27 19:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2911290>
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_6cad3e834a10232469bd8fa5ed58f8df.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_6cad3e834a10232469bd8fa5ed58f8df.jpg saved to cache
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29536d0>
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_c7bb4f1e6915f295b5b60ebf3eaf3d50.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_c7bb4f1e6915f295b5b60ebf3eaf3d50.jpg saved to cache
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with identifier: NP69601
2026-03-27 19:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with identifier: NP69601
2026-03-27 19:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with identifier: NP69601 to the API
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_b76a72da8c1fad9df4781548fe6f38be.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:37:30Z',
 'fuel_type': 'petrol',
 'id': '7ad582fe-f4e2-5151-8e99-d87f1f5be2d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZB946G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP69601',
 'listing': 'auction',
 'location': 'NL, Apeldoorn',
 'make': 'Fiat',
 'model': '500',
 'odometer': 38446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2668834,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_63baa400673315216a16127fe340098b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2754086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_ff3c85c32cba147606eb153dc891a409.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2736607,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_74fe94ebe43a37bd0aea4f0671242c6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631926,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_cbb1f134193e0f01b77ad5c49b6621aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2746938,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_b76a72da8c1fad9df4781548fe6f38be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2708454,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_0ff0de63858c6d02ea33706da06d89a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_834302b2b4606e4ff14ce000e79f2d37.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2784546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_179765d4b4c258ae8d22dd52e4f874f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737188,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_752d9943f82c8d97937d09c1eb630ad4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad582fe-f4e2-5151-8e99-d87f1f5be2d5/7ad582fe-f4e2-5151-8e99-d87f1f5be2d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659976,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/68/9168d0983d2c2ad32d78d087eea40882/pa/NP69601_f42fb5f88008928f23d010eee26949d7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-27 19:12:41 [auto1.nl] INFO: Saving data for NP69601: {'created_time': 1774638761.80171, 'last_price_update_time': 1774638761.80172, 'auction_closing_time': 1774715850.0}
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NP69601') HTTP/1.1" 204 0
2026-03-27 19:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_3da98561fe0641f8837869c29cb8943b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_32049e0d46b6f1948049145d70404ecc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae28350d0>
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_27426704cfdc13230fb8359fe1ade8f6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_27426704cfdc13230fb8359fe1ade8f6.jpg saved to cache
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dad77f45-1ffc-5939-8aaf-1a5047447fff
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34d1c50>
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_250d42ea7e8b7a16fe943f4095028df0.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_250d42ea7e8b7a16fe943f4095028df0.jpg saved to cache
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dad77f45-1ffc-5939-8aaf-1a5047447fff
2026-03-27 19:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_e22bf3ea6d124608be244b63d54aab28.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae343c250>
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_3da98561fe0641f8837869c29cb8943b.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_3da98561fe0641f8837869c29cb8943b.jpg saved to cache
2026-03-27 19:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3313b10>
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_32049e0d46b6f1948049145d70404ecc.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_32049e0d46b6f1948049145d70404ecc.jpg saved to cache
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14cf79ee-0f10-554b-95d2-43660ad6962e
2026-03-27 19:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_083d21de98b6d612fb663b4a74d51bbf.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_1ea7447e40553a86079e79f75ed95f2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_63c91ba8017e9fb50545dfd3546618d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35cfdd0>
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_e22bf3ea6d124608be244b63d54aab28.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_e22bf3ea6d124608be244b63d54aab28.jpg saved to cache
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_0cf2d409c0dabcfa40b8f29be5889bc7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_b19155f2b9a4100e8e26a40222a5c1ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3323fd0>
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F5b%252F985bf40a09acc5678eff2ab808cd63ab%252Fpa%252FNR15886_083d21de98b6d612fb663b4a74d51bbf.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_083d21de98b6d612fb663b4a74d51bbf.jpg saved to cache
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dad77f45-1ffc-5939-8aaf-1a5047447fff
2026-03-27 19:12:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dad77f45-1ffc-5939-8aaf-1a5047447fff, skipping ID generation
2026-03-27 19:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dad77f45-1ffc-5939-8aaf-1a5047447fff with scrape type 1
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dad77f45-1ffc-5939-8aaf-1a5047447fff sending to next pipeline
2026-03-27 19:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dad77f45-1ffc-5939-8aaf-1a5047447fff, identifier: NR15886
2026-03-27 19:12:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae343ced0>
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_1ea7447e40553a86079e79f75ed95f2f.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_1ea7447e40553a86079e79f75ed95f2f.jpg saved to cache
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2836bd0>
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_63c91ba8017e9fb50545dfd3546618d6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_63c91ba8017e9fb50545dfd3546618d6.jpg saved to cache
2026-03-27 19:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dad77f45-1ffc-5939-8aaf-1a5047447fff with identifier: NR15886
2026-03-27 19:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dad77f45-1ffc-5939-8aaf-1a5047447fff with identifier: NR15886
2026-03-27 19:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dad77f45-1ffc-5939-8aaf-1a5047447fff with identifier: NR15886 to the API
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_083d21de98b6d612fb663b4a74d51bbf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 97,
 'expiration_date': '2026-03-28T16:37:00Z',
 'fuel_type': 'petrol',
 'id': 'dad77f45-1ffc-5939-8aaf-1a5047447fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '93grl9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR15886',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 290691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_3dcf01e113bcac5d072fae27b33f6d35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_083d21de98b6d612fb663b4a74d51bbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_27426704cfdc13230fb8359fe1ade8f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_250d42ea7e8b7a16fe943f4095028df0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_1363a469b5a3523990ad92e1d9ae7ffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad77f45-1ffc-5939-8aaf-1a5047447fff/dad77f45-1ffc-5939-8aaf-1a5047447fff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/5b/985bf40a09acc5678eff2ab808cd63ab/pa/NR15886_e87300b80fa71b1e45f3d438d34bf4a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.4 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2008}
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-27 19:12:42 [auto1.nl] INFO: Saving data for NR15886: {'created_time': 1774638762.874887, 'last_price_update_time': 1774638762.874897, 'auction_closing_time': 1774715820.0}
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NR15886') HTTP/1.1" 204 0
2026-03-27 19:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_6db5a193f36217ec89b11a29425631d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_6ecccfe0ceaf60645fa7568b558af9e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_5083b2cac89cab90193e4ddb3addbc12.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae358fe10>
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_0cf2d409c0dabcfa40b8f29be5889bc7.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_0cf2d409c0dabcfa40b8f29be5889bc7.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35e8f10>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_b19155f2b9a4100e8e26a40222a5c1ed.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_b19155f2b9a4100e8e26a40222a5c1ed.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_ed1738336a71ed6277580f08e760eb11.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34a8790>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_6db5a193f36217ec89b11a29425631d1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_6db5a193f36217ec89b11a29425631d1.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae297ec10>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_6ecccfe0ceaf60645fa7568b558af9e8.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_6ecccfe0ceaf60645fa7568b558af9e8.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14cf79ee-0f10-554b-95d2-43660ad6962e
2026-03-27 19:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae290a1d0>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_5083b2cac89cab90193e4ddb3addbc12.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_5083b2cac89cab90193e4ddb3addbc12.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_77ca95e61d5039db8bcc5dce50e02c7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34d1110>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_ed1738336a71ed6277580f08e760eb11.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_ed1738336a71ed6277580f08e760eb11.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14cf79ee-0f10-554b-95d2-43660ad6962e
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3428e2f22dd6bffcd9642c35e3870a95.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_87ac85aae74b7a0d9cd7afc85bad1742.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_a9b2dd7fa0c359feab1bac917c331bdb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_888b09ab7e97b9fa53fd03c04ee43338.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_b84fd6eebc488d29fb8ef0dd688956ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_2cb22eb60d2cfdd235801b2f661f536e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3323490>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_77ca95e61d5039db8bcc5dce50e02c7a.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_77ca95e61d5039db8bcc5dce50e02c7a.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_4b094b464bdab9ecd53555fea0413ef1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_4ce4f7dfbce9a14c0ac5010803e3a3ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_17acacc29d9fb24e62d82db019505356.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_0330c8eb91518882ef09fa1f7916a446.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35cf450>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_3428e2f22dd6bffcd9642c35e3870a95.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3428e2f22dd6bffcd9642c35e3870a95.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34650d0>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_87ac85aae74b7a0d9cd7afc85bad1742.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_87ac85aae74b7a0d9cd7afc85bad1742.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3592050>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_a9b2dd7fa0c359feab1bac917c331bdb.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_a9b2dd7fa0c359feab1bac917c331bdb.jpg saved to cache
2026-03-27 19:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b3bd0>
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_888b09ab7e97b9fa53fd03c04ee43338.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_888b09ab7e97b9fa53fd03c04ee43338.jpg saved to cache
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34b3890>
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_b84fd6eebc488d29fb8ef0dd688956ef.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_b84fd6eebc488d29fb8ef0dd688956ef.jpg saved to cache
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9674490>
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_2cb22eb60d2cfdd235801b2f661f536e.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_2cb22eb60d2cfdd235801b2f661f536e.jpg saved to cache
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33b7490>
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_4b094b464bdab9ecd53555fea0413ef1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_4b094b464bdab9ecd53555fea0413ef1.jpg saved to cache
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14cf79ee-0f10-554b-95d2-43660ad6962e
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3204b90>
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_4ce4f7dfbce9a14c0ac5010803e3a3ac.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_4ce4f7dfbce9a14c0ac5010803e3a3ac.jpg saved to cache
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae329aa10>
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc1%252Fb4c107fd771b1b9cc0ded93906286170%252Fpa%252FPN82428_17acacc29d9fb24e62d82db019505356.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_17acacc29d9fb24e62d82db019505356.jpg saved to cache
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14cf79ee-0f10-554b-95d2-43660ad6962e
2026-03-27 19:12:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14cf79ee-0f10-554b-95d2-43660ad6962e, skipping ID generation
2026-03-27 19:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14cf79ee-0f10-554b-95d2-43660ad6962e with scrape type 1
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14cf79ee-0f10-554b-95d2-43660ad6962e sending to next pipeline
2026-03-27 19:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14cf79ee-0f10-554b-95d2-43660ad6962e, identifier: PN82428
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35ea590>
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c243e1e5d3b6f405bb64571450966e%252Fpa%252FUJ05110_0330c8eb91518882ef09fa1f7916a446.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_0330c8eb91518882ef09fa1f7916a446.jpg saved to cache
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05
2026-03-27 19:12:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05, skipping ID generation
2026-03-27 19:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with scrape type 1
2026-03-27 19:12:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 sending to next pipeline
2026-03-27 19:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05, identifier: UJ05110
2026-03-27 19:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14cf79ee-0f10-554b-95d2-43660ad6962e with identifier: PN82428
2026-03-27 19:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14cf79ee-0f10-554b-95d2-43660ad6962e with identifier: PN82428
2026-03-27 19:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14cf79ee-0f10-554b-95d2-43660ad6962e with identifier: PN82428 to the API
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_17acacc29d9fb24e62d82db019505356.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:07:55Z',
 'fuel_type': 'petrol',
 'id': '14cf79ee-0f10-554b-95d2-43660ad6962e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '14ZNDD',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN82428',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 108444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_17acacc29d9fb24e62d82db019505356.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_4b094b464bdab9ecd53555fea0413ef1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_ed1738336a71ed6277580f08e760eb11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_6ecccfe0ceaf60645fa7568b558af9e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cf79ee-0f10-554b-95d2-43660ad6962e/14cf79ee-0f10-554b-95d2-43660ad6962e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c1/b4c107fd771b1b9cc0ded93906286170/pa/PN82428_32049e0d46b6f1948049145d70404ecc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Sport Plus',
 'transmission': 'manual',
 'trim': 'Sport Plus',
 'year': 2008}
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-27 19:12:44 [auto1.nl] INFO: Saving data for PN82428: {'created_time': 1774638764.951813, 'last_price_update_time': 1774638764.951827, 'auction_closing_time': 1774714075.0}
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PN82428') HTTP/1.1" 204 0
2026-03-27 19:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with identifier: UJ05110
2026-03-27 19:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with identifier: UJ05110
2026-03-27 19:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with identifier: UJ05110 to the API
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_0330c8eb91518882ef09fa1f7916a446.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:34:08Z',
 'fuel_type': 'petrol',
 'id': 'bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '76PBZZ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ05110',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Hyundai',
 'model': 'Getz',
 'odometer': 172253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_0330c8eb91518882ef09fa1f7916a446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_4ce4f7dfbce9a14c0ac5010803e3a3ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_77ca95e61d5039db8bcc5dce50e02c7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_6db5a193f36217ec89b11a29425631d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05/bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c243e1e5d3b6f405bb64571450966e/pa/UJ05110_3da98561fe0641f8837869c29cb8943b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Getz 1.3 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2004}
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-27 19:12:45 [auto1.nl] INFO: Saving data for UJ05110: {'created_time': 1774638765.298375, 'last_price_update_time': 1774638765.298385, 'auction_closing_time': 1774715648.0}
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UJ05110') HTTP/1.1" 204 0
2026-03-27 19:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_6f2b47a76136367945a6a257bda1b988.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3048710f9b3fd66fdef4d75e12403832.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_abe59fd3488691a91b689caa68be713c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3990fa13ac33163a732dbc009c6af076.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_d0f29e41b223926183744cb667a8baa6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_9ac690eaa64b1f9a6105037d9c9f188f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae826ca90>
2026-03-27 19:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd5%252Fecd52c34f4f7df6003c481ea20f2771f%252Fpa%252FYR49127_6f2b47a76136367945a6a257bda1b988.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_6f2b47a76136367945a6a257bda1b988.jpg saved to cache
2026-03-27 19:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c27b70ed-0a59-5f7b-bc13-c42d28190b64
2026-03-27 19:12:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c27b70ed-0a59-5f7b-bc13-c42d28190b64, skipping ID generation
2026-03-27 19:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c27b70ed-0a59-5f7b-bc13-c42d28190b64 with scrape type 1
2026-03-27 19:12:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c27b70ed-0a59-5f7b-bc13-c42d28190b64 sending to next pipeline
2026-03-27 19:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c27b70ed-0a59-5f7b-bc13-c42d28190b64, identifier: YR49127
2026-03-27 19:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c27b70ed-0a59-5f7b-bc13-c42d28190b64 with identifier: YR49127
2026-03-27 19:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c27b70ed-0a59-5f7b-bc13-c42d28190b64 with identifier: YR49127
2026-03-27 19:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c27b70ed-0a59-5f7b-bc13-c42d28190b64 with identifier: YR49127 to the API
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_6f2b47a76136367945a6a257bda1b988.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 332,
 'expiration_date': '2026-03-28T16:07:55Z',
 'fuel_type': 'electro',
 'id': 'c27b70ed-0a59-5f7b-bc13-c42d28190b64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RB428J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR49127',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Tesla',
 'model': 'Model S',
 'odometer': 160983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2734758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_6f2b47a76136367945a6a257bda1b988.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830437,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_262a8a47687710c791920b12f2c06ab4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2843967,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_a9b2dd7fa0c359feab1bac917c331bdb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2752603,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_1ea7447e40553a86079e79f75ed95f2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2707633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_0cf2d409c0dabcfa40b8f29be5889bc7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759790,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_c7bb4f1e6915f295b5b60ebf3eaf3d50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2853933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_ff47beaa57a01392f1e2d1210584d93c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2783473,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_765c8abca54bb20cdc2d88c72267cd6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614142,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_a718dc83836f6b4bc549deb8de891f61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c27b70ed-0a59-5f7b-bc13-c42d28190b64/c27b70ed-0a59-5f7b-bc13-c42d28190b64_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d5/ecd52c34f4f7df6003c481ea20f2771f/pa/YR49127_335d0e5c448d8ef4a55fab2b710b659f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model S 70D Dual',
 'transmission': 'automatic',
 'trim': 'Dual',
 'year': 2017}
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-27 19:12:45 [auto1.nl] INFO: Saving data for YR49127: {'created_time': 1774638765.98776, 'last_price_update_time': 1774638765.987769, 'auction_closing_time': 1774714075.0}
2026-03-27 19:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YR49127') HTTP/1.1" 204 0
2026-03-27 19:12:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29d32d0>
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_3048710f9b3fd66fdef4d75e12403832.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3048710f9b3fd66fdef4d75e12403832.jpg saved to cache
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae294aa50>
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_abe59fd3488691a91b689caa68be713c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_abe59fd3488691a91b689caa68be713c.jpg saved to cache
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3204250>
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd3%252F67d3b735bb2eb5e6f8b221842c1c7a8e%252Fpa%252FWP95967_3990fa13ac33163a732dbc009c6af076.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3990fa13ac33163a732dbc009c6af076.jpg saved to cache
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc898ff4-2139-54fa-9dd0-de35a68bd729
2026-03-27 19:12:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc898ff4-2139-54fa-9dd0-de35a68bd729, skipping ID generation
2026-03-27 19:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc898ff4-2139-54fa-9dd0-de35a68bd729 with scrape type 1
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc898ff4-2139-54fa-9dd0-de35a68bd729 sending to next pipeline
2026-03-27 19:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cc898ff4-2139-54fa-9dd0-de35a68bd729, identifier: WP95967
2026-03-27 19:12:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae933ef50>
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_d0f29e41b223926183744cb667a8baa6.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_d0f29e41b223926183744cb667a8baa6.jpg saved to cache
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae9673090>
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_9ac690eaa64b1f9a6105037d9c9f188f.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_9ac690eaa64b1f9a6105037d9c9f188f.jpg saved to cache
2026-03-27 19:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cc898ff4-2139-54fa-9dd0-de35a68bd729 with identifier: WP95967
2026-03-27 19:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cc898ff4-2139-54fa-9dd0-de35a68bd729 with identifier: WP95967
2026-03-27 19:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cc898ff4-2139-54fa-9dd0-de35a68bd729 with identifier: WP95967 to the API
2026-03-27 19:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3990fa13ac33163a732dbc009c6af076.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:43:03Z',
 'fuel_type': 'petrol',
 'id': 'cc898ff4-2139-54fa-9dd0-de35a68bd729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '9SZH44',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP95967',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 243194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414138,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_0bb83de341491dd510779da9e4c6f2ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550460,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_8babb4c163a9d3735e78cd6cca5a8a95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2434481,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3990fa13ac33163a732dbc009c6af076.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2239467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3048710f9b3fd66fdef4d75e12403832.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_2cb22eb60d2cfdd235801b2f661f536e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2495186,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_888b09ab7e97b9fa53fd03c04ee43338.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2291717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_3428e2f22dd6bffcd9642c35e3870a95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2678597,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_b19155f2b9a4100e8e26a40222a5c1ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2444562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_e22bf3ea6d124608be244b63d54aab28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc898ff4-2139-54fa-9dd0-de35a68bd729/cc898ff4-2139-54fa-9dd0-de35a68bd729_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d3/67d3b735bb2eb5e6f8b221842c1c7a8e/pa/WP95967_d34520755368d5edaa923faf2d752671.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 Summum 2WD',
 'transmission': 'automatic',
 'trim': 'Summum 2WD',
 'year': 2014}
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Saving data for WP95967: {'created_time': 1774638767.142634, 'last_price_update_time': 1774638767.142644, 'auction_closing_time': 1774716183.0}
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WP95967') HTTP/1.1" 204 0
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC58225> (referer: https://www.auto1.com/v1/car-details-view/HC58225/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_1cb31d262db6c16ed52dde393cc02960.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_57c2978ba5af8dbd850c5b420bda1c79.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_d78466972adf004f558d272270febc0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_2e1d57f6132de2a533fd0956733b1873.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_f31b46ee4500a25800612b6f19d2c9b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_e01279b0e1930a758e66c5734898409e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_f63a52d734bbe7863ed7ddcb92ab994a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_870044c8d8345efb19bc43f6b118511d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:47 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 916 | hits on page: 40
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS59030%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for HS59030: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV01442%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for AV01442: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for FC64695: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for RC74760: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU15419%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for BU15419: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST70882%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for ST70882: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: AB92284
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ76935%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for ZZ76935: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ37745%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for DZ37745: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for BU16200: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for NX47084: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for SY53039: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW03238%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for AW03238: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for YN37403: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN83420%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for GN83420: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW44039%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for BW44039: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK86795%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for FK86795: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for NV18219: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL65263%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for NL65263: 0
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-27 19:12:47 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL62057%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [auto1.nl] INFO: Scrape type for ZL62057: 0
2026-03-27 19:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc62df0-ef04-543d-8023-d8c9492ee56d with identifier: HC58225
2026-03-27 19:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc62df0-ef04-543d-8023-d8c9492ee56d with scrape type 1
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_6cd43d334178c39749cb8f1b7c11471d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_6cd43d334178c39749cb8f1b7c11471d.jpg not downloaded yet
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_ede6b98bee9c727da377a54f087acf95.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_ede6b98bee9c727da377a54f087acf95.jpg not downloaded yet
2026-03-27 19:12:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3206450>
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_1cb31d262db6c16ed52dde393cc02960.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_1cb31d262db6c16ed52dde393cc02960.jpg saved to cache
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29e6550>
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_57c2978ba5af8dbd850c5b420bda1c79.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_57c2978ba5af8dbd850c5b420bda1c79.jpg saved to cache
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34ebd90>
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff2%252F09f2cd242f9a02deb4bac5b5c88681a1%252Fpa%252FHD17412_d78466972adf004f558d272270febc0e.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_d78466972adf004f558d272270febc0e.jpg saved to cache
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a
2026-03-27 19:12:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a, skipping ID generation
2026-03-27 19:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with scrape type 1
2026-03-27 19:12:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a sending to next pipeline
2026-03-27 19:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a, identifier: HD17412
2026-03-27 19:12:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae34650d0>
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_2e1d57f6132de2a533fd0956733b1873.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_2e1d57f6132de2a533fd0956733b1873.jpg saved to cache
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33af650>
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_f31b46ee4500a25800612b6f19d2c9b4.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_f31b46ee4500a25800612b6f19d2c9b4.jpg saved to cache
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2942a50>
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_e01279b0e1930a758e66c5734898409e.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_e01279b0e1930a758e66c5734898409e.jpg saved to cache
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae35a9590>
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F34%252Fdf348a644ad5ee751d30923d5a848007%252Fpa%252FFB31523_f63a52d734bbe7863ed7ddcb92ab994a.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_f63a52d734bbe7863ed7ddcb92ab994a.jpg saved to cache
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1
2026-03-27 19:12:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21982b56-1d48-59a4-94bd-0f25f4ca92f1, skipping ID generation
2026-03-27 19:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1 with scrape type 1
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21982b56-1d48-59a4-94bd-0f25f4ca92f1 sending to next pipeline
2026-03-27 19:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 21982b56-1d48-59a4-94bd-0f25f4ca92f1, identifier: FB31523
2026-03-27 19:12:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae29d3dd0>
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_870044c8d8345efb19bc43f6b118511d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_870044c8d8345efb19bc43f6b118511d.jpg saved to cache
2026-03-27 19:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with identifier: HD17412
2026-03-27 19:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with identifier: HD17412
2026-03-27 19:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with identifier: HD17412 to the API
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_d78466972adf004f558d272270febc0e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 2',
 'engine': '2.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:31:25Z',
 'fuel_type': 'diesel',
 'id': '2a10ffc9-089c-5117-b04d-b86cdc42ce0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '9tlv14',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD17412',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Volkswagen',
 'model': 'T4 Multivan',
 'odometer': 390049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769389,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_d78466972adf004f558d272270febc0e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2798991,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_d0f29e41b223926183744cb667a8baa6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_9ac690eaa64b1f9a6105037d9c9f188f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2834370,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_1cb31d262db6c16ed52dde393cc02960.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_abe59fd3488691a91b689caa68be713c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_b84fd6eebc488d29fb8ef0dd688956ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047008,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_87ac85aae74b7a0d9cd7afc85bad1742.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2846265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_5083b2cac89cab90193e4ddb3addbc12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590107,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_63c91ba8017e9fb50545dfd3546618d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a10ffc9-089c-5117-b04d-b86cdc42ce0a/2a10ffc9-089c-5117-b04d-b86cdc42ce0a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2786663,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f2/09f2cd242f9a02deb4bac5b5c88681a1/pa/HD17412_6cad3e834a10232469bd8fa5ed58f8df.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-10-13',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Volkswagen T4 Multivan 2.5 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-27 19:12:49 [auto1.nl] INFO: Saving data for HD17412: {'created_time': 1774638769.086254, 'last_price_update_time': 1774638769.086264, 'auction_closing_time': 1774715485.0}
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HD17412') HTTP/1.1" 204 0
2026-03-27 19:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 21982b56-1d48-59a4-94bd-0f25f4ca92f1 with identifier: FB31523
2026-03-27 19:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 21982b56-1d48-59a4-94bd-0f25f4ca92f1 with identifier: FB31523
2026-03-27 19:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 21982b56-1d48-59a4-94bd-0f25f4ca92f1 with identifier: FB31523 to the API
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_f63a52d734bbe7863ed7ddcb92ab994a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:51Z',
 'fuel_type': 'petrol',
 'id': '21982b56-1d48-59a4-94bd-0f25f4ca92f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '54PVT1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB31523',
 'listing': 'auction',
 'location': 'NL, Alkmaar',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 183413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2249564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_a4862cbbfae85bb00b8068321147ea67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2320720,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_a64149530d66da1c3b706015c96156f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2015599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_6ddb811f4fff440e7398a84fb58b1c14.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2258351,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_e01279b0e1930a758e66c5734898409e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1989719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_57c2978ba5af8dbd850c5b420bda1c79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2191519,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_f31b46ee4500a25800612b6f19d2c9b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2228776,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_2e1d57f6132de2a533fd0956733b1873.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2241461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_b2fb53f940215af4e2e9457921467a2c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2164838,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_02c88f719e06d450c7316f86cdc540d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21982b56-1d48-59a4-94bd-0f25f4ca92f1/21982b56-1d48-59a4-94bd-0f25f4ca92f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2301808,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/34/df348a644ad5ee751d30923d5a848007/pa/FB31523_f63a52d734bbe7863ed7ddcb92ab994a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.4 TSI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB31523%27 HTTP/1.1" 200 None
2026-03-27 19:12:49 [auto1.nl] INFO: Saving data for FB31523: {'created_time': 1774638769.97436, 'last_price_update_time': 1774638769.974369, 'auction_closing_time': 1774715571.0}
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB31523') HTTP/1.1" 204 0
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_cf0c9dbc2bb2e69efe9c482a3f64bf1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_cf0c9dbc2bb2e69efe9c482a3f64bf1c.jpg not downloaded yet
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_6e9d450bd0d640f116af36c43df2a6a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_6e9d450bd0d640f116af36c43df2a6a3.jpg not downloaded yet
2026-03-27 19:12:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_b60c0c9869034c0b04cfe41b376f81b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_b60c0c9869034c0b04cfe41b376f81b5.jpg not downloaded yet
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_7ffce46ac6b4d646d64ec7da9c40851c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_7ffce46ac6b4d646d64ec7da9c40851c.jpg not downloaded yet
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_2d405bca776026b4428e33ac7a9fdccc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_2d405bca776026b4428e33ac7a9fdccc.jpg not downloaded yet
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_858fe83ce24e7cd3bb7db5ab11dad204.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_858fe83ce24e7cd3bb7db5ab11dad204.jpg not downloaded yet
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_a7eeabab064a7784f62a195fbbb470f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_a7eeabab064a7784f62a195fbbb470f1.jpg not downloaded yet
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_718ffeed67b9de4591e127a41f711cb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_718ffeed67b9de4591e127a41f711cb7.jpg not downloaded yet
2026-03-27 19:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_2bca959e96a855c44b42ff34fefc8c86.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_b9311541f61870d39fdfca740d07f6c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae283d9d0>
2026-03-27 19:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_2bca959e96a855c44b42ff34fefc8c86.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_2bca959e96a855c44b42ff34fefc8c86.jpg saved to cache
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae333c050>
2026-03-27 19:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a815975b8559ecf1a72bd6912755ab%252Fpa%252FGN05115_b9311541f61870d39fdfca740d07f6c4.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_b9311541f61870d39fdfca740d07f6c4.jpg saved to cache
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852
2026-03-27 19:12:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4437e5ca-3ec4-5092-b5b2-caefdcc12852, skipping ID generation
2026-03-27 19:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with scrape type 1
2026-03-27 19:12:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852 sending to next pipeline
2026-03-27 19:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4437e5ca-3ec4-5092-b5b2-caefdcc12852, identifier: GN05115
2026-03-27 19:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with identifier: GN05115
2026-03-27 19:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with identifier: GN05115
2026-03-27 19:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with identifier: GN05115 to the API
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_b9311541f61870d39fdfca740d07f6c4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:30:49Z',
 'fuel_type': 'petrol',
 'id': '4437e5ca-3ec4-5092-b5b2-caefdcc12852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K431GB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN05115',
 'listing': 'auction',
 'location': 'NL, Apeldoorn',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 85645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2489206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_0b256a9ef5fc3df1945fbbea6b784510.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_b9311541f61870d39fdfca740d07f6c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2513580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_2bca959e96a855c44b42ff34fefc8c86.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2209925,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_b3ea3f8d25adef0ba155f1a8d6d539ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497663,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_870044c8d8345efb19bc43f6b118511d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2484326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_8f38a83c413d51467ce7a64f2f6b5eb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2344191,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_38dd763c9bce8924c7cb2e01d7eef574.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611658,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_bd406371845a43655459d6426932cd70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_57b15f3e2081d4c794e04b835c6cf2da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4437e5ca-3ec4-5092-b5b2-caefdcc12852/4437e5ca-3ec4-5092-b5b2-caefdcc12852_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a815975b8559ecf1a72bd6912755ab/pa/GN05115_9961f136df0647fa78735c58a5d1dfba.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-27 19:12:50 [auto1.nl] INFO: Saving data for GN05115: {'created_time': 1774638770.873594, 'last_price_update_time': 1774638770.873604, 'auction_closing_time': 1774715449.0}
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN05115') HTTP/1.1" 204 0
2026-03-27 19:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_ede6b98bee9c727da377a54f087acf95.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_6e9d450bd0d640f116af36c43df2a6a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD36085> (referer: https://www.auto1.com/v1/car-details-view/KD36085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_b60c0c9869034c0b04cfe41b376f81b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_cf0c9dbc2bb2e69efe9c482a3f64bf1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_7ffce46ac6b4d646d64ec7da9c40851c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_858fe83ce24e7cd3bb7db5ab11dad204.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_6cd43d334178c39749cb8f1b7c11471d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae333ce10>
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_ede6b98bee9c727da377a54f087acf95.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_ede6b98bee9c727da377a54f087acf95.jpg saved to cache
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3380050>
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_6e9d450bd0d640f116af36c43df2a6a3.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_6e9d450bd0d640f116af36c43df2a6a3.jpg saved to cache
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with identifier: KD36085
2026-03-27 19:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with scrape type 1
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_8656d0f9365025939812200cfda173b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_8656d0f9365025939812200cfda173b4.jpg already downloaded
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_3d87b5374c47cbce07123c37bd2d6b3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_3d87b5374c47cbce07123c37bd2d6b3f.jpg already downloaded
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_1826c02339456bb99ab64374ead290c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_1826c02339456bb99ab64374ead290c5.jpg already downloaded
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_b672125429c961d4238031cdc5718180.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_b672125429c961d4238031cdc5718180.jpg already downloaded
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_96f6b625b8a1747438e905351cd313ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_96f6b625b8a1747438e905351cd313ab.jpg already downloaded
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_3d768c77e62941c8d22ba9cb9205d532.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_3d768c77e62941c8d22ba9cb9205d532.jpg already downloaded
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_8e83246ec633c911e0ba4e35b7db4df0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_8e83246ec633c911e0ba4e35b7db4df0.jpg already downloaded
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_f653af2c5c53b5d0cf8a7e655b75d7bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_f653af2c5c53b5d0cf8a7e655b75d7bf.jpg already downloaded
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_bd1be0a34ca8b1f8411350579a06b86e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_bd1be0a34ca8b1f8411350579a06b86e.jpg already downloaded
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F80%252F95803922c15f7758c99d2eccfa33ac83%252Fpa%252FKD36085_0cb6390a41c1951a7c18bd0861ae93fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_0cb6390a41c1951a7c18bd0861ae93fc.jpg already downloaded
2026-03-27 19:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829, identifier: KD36085
2026-03-27 19:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae3382b10>
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_b60c0c9869034c0b04cfe41b376f81b5.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_b60c0c9869034c0b04cfe41b376f81b5.jpg saved to cache
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae32a3b90>
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_cf0c9dbc2bb2e69efe9c482a3f64bf1c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_cf0c9dbc2bb2e69efe9c482a3f64bf1c.jpg saved to cache
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2819ad0>
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_7ffce46ac6b4d646d64ec7da9c40851c.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_7ffce46ac6b4d646d64ec7da9c40851c.jpg saved to cache
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae33ad210>
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_858fe83ce24e7cd3bb7db5ab11dad204.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_858fe83ce24e7cd3bb7db5ab11dad204.jpg saved to cache
2026-03-27 19:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae28105d0>
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_6cd43d334178c39749cb8f1b7c11471d.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_6cd43d334178c39749cb8f1b7c11471d.jpg saved to cache
2026-03-27 19:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with identifier: KD36085
2026-03-27 19:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with identifier: KD36085
2026-03-27 19:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with identifier: KD36085 to the API
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KD36085>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:16:30Z',
 'fuel_type': 'petrol',
 'id': '8b59c4f7-2ae1-5bbc-96fa-f372c4e86829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L547NS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD36085',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 76273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_8656d0f9365025939812200cfda173b4.jpg',
                'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_3d87b5374c47cbce07123c37bd2d6b3f.jpg',
                'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_1826c02339456bb99ab64374ead290c5.jpg',
                'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_b672125429c961d4238031cdc5718180.jpg',
                'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_96f6b625b8a1747438e905351cd313ab.jpg',
                'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_3d768c77e62941c8d22ba9cb9205d532.jpg',
                'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_8e83246ec633c911e0ba4e35b7db4df0.jpg',
                'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_f653af2c5c53b5d0cf8a7e655b75d7bf.jpg',
                'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_bd1be0a34ca8b1f8411350579a06b86e.jpg',
                'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_0cb6390a41c1951a7c18bd0861ae93fc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_8656d0f9365025939812200cfda173b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_3d87b5374c47cbce07123c37bd2d6b3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_1826c02339456bb99ab64374ead290c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_b672125429c961d4238031cdc5718180.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_96f6b625b8a1747438e905351cd313ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_3d768c77e62941c8d22ba9cb9205d532.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_8e83246ec633c911e0ba4e35b7db4df0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_f653af2c5c53b5d0cf8a7e655b75d7bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_bd1be0a34ca8b1f8411350579a06b86e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b59c4f7-2ae1-5bbc-96fa-f372c4e86829/8b59c4f7-2ae1-5bbc-96fa-f372c4e86829_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/80/95803922c15f7758c99d2eccfa33ac83/pa/KD36085_0cb6390a41c1951a7c18bd0861ae93fc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 THP Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2015}
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Saving data for KD36085: {'created_time': 1774638772.365037, 'last_price_update_time': 1774638772.365046, 'auction_closing_time': 1774714590.0}
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KD36085') HTTP/1.1" 204 0
2026-03-27 19:12:52 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 916 | hits on page: 40
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA07201%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for PA07201: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU34213%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for WU34213: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for GP63449: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for FK39304: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for TC15988: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for WK29789: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for YH72796: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for FE21861: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for SV00912: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for BP06390: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for SV78620: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for JX11008: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for YT76844: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for RC74228: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for PA43644: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for NT33284: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX77318%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for AX77318: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for FR61201: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-27 19:12:52 [auto1.nl] INFO: Scrape type for ZP69271: 0
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-27 19:12:52 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-27 19:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_2d405bca776026b4428e33ac7a9fdccc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_a7eeabab064a7784f62a195fbbb470f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_718ffeed67b9de4591e127a41f711cb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:12:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2832ad0>
2026-03-27 19:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_2d405bca776026b4428e33ac7a9fdccc.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_2d405bca776026b4428e33ac7a9fdccc.jpg saved to cache
2026-03-27 19:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae2831410>
2026-03-27 19:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_a7eeabab064a7784f62a195fbbb470f1.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_a7eeabab064a7784f62a195fbbb470f1.jpg saved to cache
2026-03-27 19:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faae337f390>
2026-03-27 19:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2f%252F282f03b1afc0290d99b8f7b930f60ebe%252Fpa%252FHC58225_718ffeed67b9de4591e127a41f711cb7.jpg') HTTP/1.1" 204 0
2026-03-27 19:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_718ffeed67b9de4591e127a41f711cb7.jpg saved to cache
2026-03-27 19:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1cc62df0-ef04-543d-8023-d8c9492ee56d
2026-03-27 19:12:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cc62df0-ef04-543d-8023-d8c9492ee56d, skipping ID generation
2026-03-27 19:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc62df0-ef04-543d-8023-d8c9492ee56d with scrape type 1
2026-03-27 19:12:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cc62df0-ef04-543d-8023-d8c9492ee56d sending to next pipeline
2026-03-27 19:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1cc62df0-ef04-543d-8023-d8c9492ee56d, identifier: HC58225
2026-03-27 19:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1cc62df0-ef04-543d-8023-d8c9492ee56d with identifier: HC58225
2026-03-27 19:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1cc62df0-ef04-543d-8023-d8c9492ee56d with identifier: HC58225
2026-03-27 19:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1cc62df0-ef04-543d-8023-d8c9492ee56d with identifier: HC58225 to the API
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_718ffeed67b9de4591e127a41f711cb7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:27:10Z',
 'fuel_type': 'diesel',
 'id': '1cc62df0-ef04-543d-8023-d8c9492ee56d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7ZSN40',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC58225',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 334609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519700,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_6cd43d334178c39749cb8f1b7c11471d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2529397,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_ede6b98bee9c727da377a54f087acf95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_cf0c9dbc2bb2e69efe9c482a3f64bf1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_6e9d450bd0d640f116af36c43df2a6a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2694771,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_b60c0c9869034c0b04cfe41b376f81b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2723393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_7ffce46ac6b4d646d64ec7da9c40851c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729348,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_2d405bca776026b4428e33ac7a9fdccc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2668591,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_858fe83ce24e7cd3bb7db5ab11dad204.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_a7eeabab064a7784f62a195fbbb470f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc62df0-ef04-543d-8023-d8c9492ee56d/1cc62df0-ef04-543d-8023-d8c9492ee56d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2797479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2f/282f03b1afc0290d99b8f7b930f60ebe/pa/HC58225_718ffeed67b9de4591e127a41f711cb7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI GreenLine',
 'transmission': 'manual',
 'trim': 'GreenLine',
 'year': 2014}
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-27 19:12:53 [auto1.nl] INFO: Saving data for HC58225: {'created_time': 1774638773.604405, 'last_price_update_time': 1774638773.604415, 'auction_closing_time': 1774715230.0}
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HC58225') HTTP/1.1" 204 0
2026-03-27 19:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:54 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 916 | hits on page: 40
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for YB51800: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT81231%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for CT81231: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for JN77730: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for AE06801: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for VR09113: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for MW03156: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for WG27101: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for AX06352: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for YE50957: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for EU67961: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK52304%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for PK52304: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for SY05694: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for ZL63379: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW07946%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for SW07946: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for CK43593: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG40529%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for XG40529: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for FR68688: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-27 19:12:54 [auto1.nl] INFO: Scrape type for HK90585: 0
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-27 19:12:54 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-27 19:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:55 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 916 | hits on page: 36
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-27 19:12:55 [auto1.nl] INFO: Scrape type for CR31925: 0
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM13348%27 HTTP/1.1" 200 None
2026-03-27 19:12:55 [auto1.nl] INFO: Scrape type for BM13348: 0
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-27 19:12:55 [auto1.nl] INFO: Scrape type for FP18275: 0
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-27 19:12:55 [auto1.nl] INFO: Scrape type for BV58634: 0
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-27 19:12:55 [auto1.nl] INFO: Scrape type for MD45251: 0
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM47540%27 HTTP/1.1" 200 None
2026-03-27 19:12:55 [auto1.nl] INFO: Scrape type for RM47540: 0
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-27 19:12:55 [auto1.nl] INFO: Scrape type for DZ87358: 0
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-27 19:12:55 [auto1.nl] INFO: Scrape type for GN29290: 0
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-27 19:12:55 [auto1.nl] INFO: Scrape type for DN96174: 0
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-27 19:12:55 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-27 19:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG27703%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for BG27703: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for EB00697: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for ES69537: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for WY03082: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for CJ41969: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for UF96545: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for GL61326: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for SY10793: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for EY85081: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for RP15329: 0
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-27 19:12:56 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-27 19:12:56 [auto1.nl] INFO: Scrape type for TB82163: 0
2026-03-27 19:12:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:12:56 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 916 | hits on page: 0
2026-03-27 19:12:56 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 19:12:56 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-27 19:12:56 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 38, <ScrapeType.BATCH_SKIPPED: 5>: 38}
2026-03-27 19:12:57 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (203 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-27T19_10_00.jl
2026-03-27 19:12:57 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 800514,
 'downloader/request_count': 454,
 'downloader/request_method_count/GET': 428,
 'downloader/request_method_count/POST': 26,
 'downloader/response_bytes': 359313499,
 'downloader/response_count': 454,
 'downloader/response_status_count/200': 454,
 'dupefilter/filtered': 5,
 'elapsed_time_seconds': 170.408894,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 19, 12, 57, 126244, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 203,
 'log_count/DEBUG': 5462,
 'log_count/INFO': 5470,
 'memusage/max': 200818688,
 'memusage/startup': 147451904,
 'photo_download_count': 284,
 'request_depth_max': 27,
 'response_received_count': 170,
 'scheduler/dequeued': 454,
 'scheduler/dequeued/memory': 454,
 'scheduler/enqueued': 454,
 'scheduler/enqueued/memory': 454,
 'scrape_type/batch_skipped': 479,
 'scrape_type/new': 71,
 'scrape_type/price_update': 132,
 'scrape_type/skipped': 269,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 170,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.4595478724743063,
 'scrapy-zyte-api/mean_response_seconds': 3.4818752318702866,
 'scrapy-zyte-api/processed': 170,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 170,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 169,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 170,
 'scrapy-zyte-api/request_args/httpRequestBody': 26,
 'scrapy-zyte-api/request_args/httpRequestMethod': 26,
 'scrapy-zyte-api/request_args/httpResponseBody': 170,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 170,
 'scrapy-zyte-api/request_args/sessionContext': 170,
 'scrapy-zyte-api/request_args/url': 170,
 'scrapy-zyte-api/status_codes/200': 170,
 'scrapy-zyte-api/success': 170,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 956,
 'source/total_available': 916,
 'start_time': datetime.datetime(2026, 3, 27, 19, 10, 6, 717350, tzinfo=datetime.timezone.utc)}
2026-03-27 19:12:57 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 19:12:57 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7faae93b9b10>
2026-03-27 19:12:57 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7faae94dff50>